-- Logs begin at Wed 2022-09-07 12:19:18 UTC, end at Wed 2022-09-07 13:35:50 UTC. -- Sep 07 12:57:13.010926 dv-cinder-853315-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 12:57:13.023001 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:57:13 2022] *** Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: nodename: dv-cinder-853315-7-iscsi Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: machine: x86_64 Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: clock source: unix Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: pcre jit disabled Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: detected number of CPU cores: 4 Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: current working directory: / Sep 07 12:57:13.024983 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: your processes number limit is 47680 Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: your memory page size is 4096 bytes Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: detected max file descriptor number: 2048 Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: lock engine: pthread robust mutexes Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: thunder lock: enabled Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 12:57:13.025705 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:57:13.063922 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: Python main interpreter initialized at 0x562cde73f9c0 Sep 07 12:57:13.063922 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: python threads support enabled Sep 07 12:57:13.063922 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: your server socket listen backlog is limited to 100 connections Sep 07 12:57:13.063922 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:57:13.064324 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:57:13.064324 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: *** Operational MODE: preforking *** Sep 07 12:57:13.064598 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:57:13.064598 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: spawned uWSGI master process (pid: 105789) Sep 07 12:57:13.064815 dv-cinder-853315-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 12:57:13.065379 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: spawned uWSGI worker 1 (pid: 105790, cores: 1) Sep 07 12:57:13.065730 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: spawned uWSGI worker 2 (pid: 105791, cores: 1) Sep 07 12:57:13.065914 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:57:13.728074 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:57:13.729134 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:57:14.837981 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:14.837981 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: from cryptography.utils import int_from_bytes Sep 07 12:57:14.838614 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:14.838614 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: from cryptography.utils import int_from_bytes Sep 07 12:57:14.921714 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:14.921714 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: from cryptography.utils import int_from_bytes Sep 07 12:57:14.922384 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:14.922384 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: from cryptography.utils import int_from_bytes Sep 07 12:57:17.363448 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:57:17.364157 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:57:17.364254 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:57:17.364597 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:57:17.364701 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:57:17.364795 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:57:17.364795 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:57:17.364940 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:57:17.365149 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.365266 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:57:17.365507 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.365639 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:57:17.365817 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.365929 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.366162 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.366296 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.366453 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.366543 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.366832 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367024 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367116 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367213 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367414 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367546 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367736 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.367919 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368077 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368175 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368273 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368354 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368576 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-7-iscsi {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368720 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368886 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.368985 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369185 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369289 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-7-iscsi {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369494 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369599 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369832 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.369926 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370133 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370222 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370448 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370548 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370752 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.370897 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.371068 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.371246 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.371363 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.372452 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.372594 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.372797 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.372891 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373018 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373116 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373197 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373336 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373420 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373503 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373625 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373742 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373824 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.373902 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374024 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374169 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374298 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374481 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374572 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374802 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.374998 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-7-iscsi {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.375195 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.375375 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.375550 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-7-iscsi {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.375726 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.375862 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376026 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376196 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376366 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376503 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376682 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.376863 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377025 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377196 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377374 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377516 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377652 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377838 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.377951 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378103 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378265 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378388 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378507 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378729 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.378864 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379092 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379232 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379354 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379474 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379594 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379713 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379841 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.379963 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.380176 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.380392 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.380526 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.380675 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381342 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381435 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381517 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381605 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381706 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381805 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381896 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.381976 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382055 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382189 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382273 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382399 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382492 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382629 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382742 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.382949 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383161 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383253 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383402 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383497 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383626 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.383867 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384047 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384189 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384333 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384433 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384657 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384757 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.384966 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385064 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385274 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385386 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385580 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385708 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.385912 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386011 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386207 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386316 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386517 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386606 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386828 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.386914 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387141 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387242 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387465 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387554 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387774 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.387864 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.388077 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.388479 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.388775 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.388977 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389223 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389326 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389438 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389538 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389782 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.389876 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390106 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390208 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390412 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390503 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390718 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.390814 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391032 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391133 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391347 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391441 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391668 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391773 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.391973 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392062 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392224 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392314 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392523 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392627 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392828 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.392926 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393144 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393234 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393446 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393534 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393774 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.393879 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394081 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394228 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394393 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394568 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394665 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394847 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.394977 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395156 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395273 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395463 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395574 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395772 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.395884 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396080 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396191 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396390 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396500 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396697 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.396816 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397110 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397301 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397425 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397658 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397821 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.397962 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398085 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398227 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398362 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398537 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398660 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.398840 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399053 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399193 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399386 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399527 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399657 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399785 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.399908 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400038 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400160 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400330 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400461 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400637 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400769 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.400943 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401031 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401253 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401355 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401553 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401639 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401885 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.401984 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402192 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402287 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402490 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402577 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402794 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.402895 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403100 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403194 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403401 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403496 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403706 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.403803 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404131 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404245 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404422 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404594 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404735 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.404903 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405002 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405212 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405313 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405520 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405625 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405852 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.405961 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406161 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406255 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406454 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406558 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406761 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.406851 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407067 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407163 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407371 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407470 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407692 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.407781 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.408015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.408112 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.408327 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.408430 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.408637 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.408727 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.408942 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.409032 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.409266 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:17.409363 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.409616 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.409760 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.409969 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410061 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410287 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410389 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410605 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410693 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.410932 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411019 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411315 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411471 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411605 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411741 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.411883 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412041 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412174 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412307 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412467 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412601 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412799 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.412938 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413115 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413253 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413432 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413567 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413775 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.413878 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414088 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414175 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414405 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414498 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414732 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.414828 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415056 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415144 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415371 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415457 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415704 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.415805 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416029 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416123 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416363 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416449 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416688 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.416785 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417003 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417097 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417314 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417401 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417627 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417734 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.417968 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418055 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418314 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418408 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418628 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418723 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.418940 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419036 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419253 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419350 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419588 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419696 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.419940 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420093 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420229 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420315 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420543 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420669 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420852 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.420997 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421161 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421314 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421536 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421627 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421832 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.421971 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422148 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422287 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422470 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422602 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422785 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.422917 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423093 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423236 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423409 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423574 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423719 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.423894 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424029 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424219 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424340 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424538 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424639 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424852 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.424947 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425170 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425258 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425483 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425570 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425820 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.425923 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426136 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426232 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426443 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426531 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426750 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.426845 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427055 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427187 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427368 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427465 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427675 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427773 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.427987 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428343 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428433 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428515 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428594 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428682 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428884 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.428973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429198 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429308 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429507 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429628 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429851 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.429948 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430160 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430259 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430468 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430554 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430782 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.430870 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431085 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431182 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431391 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431479 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431708 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.431813 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432017 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432102 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432325 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432421 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432638 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432780 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.432944 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433146 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433261 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433349 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433572 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433724 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.433905 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434014 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434219 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434310 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434533 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434622 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434866 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.434972 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.435202 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.435349 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.435631 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.435729 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.435952 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436051 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436260 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436357 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436575 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436665 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436884 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.436980 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437187 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437275 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437491 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437580 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437828 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.437921 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438137 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438225 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438440 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438537 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438747 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.438846 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439053 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439142 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439358 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439459 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439679 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439786 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.439988 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440085 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440289 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440392 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440590 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440680 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440893 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.440980 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441196 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441292 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441523 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441633 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441860 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.441954 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442167 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442266 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442474 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442571 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442778 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.442882 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443128 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443238 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443440 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443537 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443757 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.443867 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444065 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444216 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444375 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444540 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444683 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444870 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.444992 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445185 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445309 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445506 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445628 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445850 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.445959 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446170 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446260 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446485 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446575 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446802 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.446899 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447127 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447216 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447441 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447529 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447764 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.447861 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448082 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448173 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448409 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448504 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448720 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.448820 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449029 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449117 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449336 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449424 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449647 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449814 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.449981 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450082 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450292 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450382 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450603 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450701 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.450968 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451059 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451287 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451413 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451597 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451738 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.451909 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452002 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452218 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452316 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452525 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452832 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.452920 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453147 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453261 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453441 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453539 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453783 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.453875 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454102 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454215 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454416 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454505 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454724 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.454811 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455042 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455140 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455348 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455437 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455655 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455749 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.455967 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456068 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456273 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456361 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456577 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456674 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456888 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.456978 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457206 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457295 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457517 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457612 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457857 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.457957 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458163 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458252 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458468 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458572 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458774 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.458863 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459076 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459164 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459378 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459466 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459686 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.459816 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460002 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460091 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460309 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460414 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460622 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460718 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.460934 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461030 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461233 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461330 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461534 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461622 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461870 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.461996 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462179 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462353 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462488 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462605 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462793 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.462883 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463096 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463238 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463417 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463504 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463723 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.463812 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464029 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464115 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464342 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464432 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464647 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464746 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.464952 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465040 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465254 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465347 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465564 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465659 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465904 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.465993 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466211 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466296 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466581 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466674 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466910 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.466998 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467217 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467303 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467515 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467611 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467826 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.467941 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468137 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468258 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468460 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468584 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468770 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.468902 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469080 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469216 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469389 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469531 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469711 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.469872 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470032 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470175 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470314 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470475 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470791 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.470928 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471104 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471253 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471422 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471570 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471735 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.471874 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472042 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472176 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472353 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472506 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472682 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.472815 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473101 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473333 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473445 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473682 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473770 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.473997 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474086 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474303 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474390 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474609 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474704 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.474919 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475228 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475323 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475531 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475628 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475836 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.475924 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476144 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476231 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476447 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476543 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476752 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.476847 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477053 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477140 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477357 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477453 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477696 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.477786 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478000 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478307 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478395 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478608 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478693 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478915 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.478999 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479221 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479309 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479519 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479614 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479820 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.479908 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480122 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480213 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480431 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480515 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480744 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.480830 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481050 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481138 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481375 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481462 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481700 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.481803 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482012 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482334 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482417 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482499 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482705 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.482812 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483008 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483154 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483313 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483463 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483616 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483797 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.483924 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484128 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484215 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484475 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484575 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484783 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.484870 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485092 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485178 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485402 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485496 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485732 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.485819 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486037 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486122 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486338 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486504 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486642 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.486953 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487038 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487259 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487353 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487562 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487650 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487865 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.487951 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488273 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488486 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488579 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488822 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.488959 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489095 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489182 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489393 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489478 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489726 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.489828 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490034 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490160 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490335 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490420 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490638 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490724 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.490946 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491033 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491254 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491339 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491555 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491653 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491865 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.491952 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492172 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492259 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492472 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492570 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492775 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.492873 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493079 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493167 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493379 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493474 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493696 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.493785 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494016 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494114 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494342 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494448 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494810 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.494967 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495066 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495279 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495382 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495582 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495670 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495886 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.495989 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496191 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496288 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496494 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496582 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496793 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.496880 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497096 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497186 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497397 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497486 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497791 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.497905 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498105 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498218 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498432 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498571 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498742 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.498880 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499045 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499183 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499348 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499488 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499636 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499783 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.499980 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500119 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500276 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500361 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500573 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500676 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500878 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.500967 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501202 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501291 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501513 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501611 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501845 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.501936 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502156 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502256 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502476 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502619 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502762 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.502851 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503077 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503172 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503384 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503482 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503700 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.503863 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504002 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504137 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504280 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504412 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504593 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504736 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.504903 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505078 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505231 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505378 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505524 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505739 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.505872 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506024 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506196 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506340 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506499 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506657 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506807 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.506966 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507400 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507491 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507571 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507650 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507729 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.507880 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508020 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508191 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508311 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508516 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508607 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508843 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.508939 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509170 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509265 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509477 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509563 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509812 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.509903 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510122 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510208 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510429 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510515 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510732 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.510819 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511044 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511138 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511351 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511445 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511656 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511743 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.511963 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512051 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512263 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512364 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512570 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512710 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512868 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.512970 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.513509 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.513680 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.513849 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.513984 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514159 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514298 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514486 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514604 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514798 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.514914 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515107 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515228 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515421 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515544 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.515863 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516041 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516170 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516346 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516654 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516786 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.516905 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517096 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517213 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517408 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517522 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517736 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.517841 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518050 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518137 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518364 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518461 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518682 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.518771 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519002 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519098 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519309 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519396 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519612 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519737 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.519935 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520053 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520242 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520367 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520565 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520682 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.520987 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521083 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521289 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521376 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521592 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521720 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.521946 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522042 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522254 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522341 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522562 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522648 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522870 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.522959 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523217 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523350 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523510 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523598 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523832 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.523927 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524149 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524265 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524458 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524569 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524783 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.524888 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525111 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525285 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525424 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525599 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525765 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.525942 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526115 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526271 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526382 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526596 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526703 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.526926 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527029 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527233 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527328 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527553 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527725 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.527864 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528049 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528190 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528360 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528518 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528683 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.528836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.529149 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.529359 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.529476 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.529746 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.529857 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530081 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530197 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530409 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530498 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.530832 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531056 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531147 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531412 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531509 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531724 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.531831 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532033 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532123 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532343 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532434 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532709 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532818 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.532932 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533014 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533257 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533371 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533562 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533825 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.533924 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534007 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534216 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534314 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534538 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534628 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534858 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.534988 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535171 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535305 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535494 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535619 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535807 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.535931 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536116 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536240 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536421 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536546 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536723 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.536872 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537068 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537177 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537371 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537504 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537707 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.537863 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538048 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538189 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538379 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538514 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538689 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.538823 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539025 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539147 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539353 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539448 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539671 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.539981 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540076 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540297 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540383 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540618 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540705 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.540920 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541020 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541222 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541308 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541527 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541613 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541858 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.541948 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542162 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542258 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542463 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542551 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542772 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.542861 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543092 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543223 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543372 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543480 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543672 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.543801 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544020 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544116 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544291 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544424 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544723 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.544821 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545113 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545199 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545421 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545528 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545750 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.545901 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546059 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546208 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546374 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546558 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546681 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546864 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.546985 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547196 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547283 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547508 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547610 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547835 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.547930 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548153 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548240 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548467 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548563 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548783 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.548870 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549086 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549181 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549391 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549479 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549727 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.549817 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550046 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550146 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550357 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550519 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550672 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550839 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.550987 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.551170 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.551311 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.551489 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.551808 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.551896 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552127 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552223 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552444 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552531 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552761 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.552850 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553080 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553168 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553404 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553490 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553741 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.553871 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554058 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554190 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554373 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554494 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554684 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.554771 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555000 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555257 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555344 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555592 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555681 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.555912 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556084 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556232 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556328 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556550 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556645 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556873 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.556998 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557182 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557274 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557496 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557586 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.557928 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558155 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558245 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558484 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558585 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558808 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.558909 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559134 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559225 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559463 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559567 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559807 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.559907 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.560130 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.560281 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.560503 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.560719 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.560810 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561044 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561132 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561475 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561580 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561818 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.561923 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562130 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562220 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562446 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562544 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562763 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.562851 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563081 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563172 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563400 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563508 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563714 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.563819 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564029 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564154 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564340 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564429 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564731 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.564916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565006 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565240 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565342 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565570 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565712 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.565925 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566049 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566253 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566399 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566574 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.566897 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567052 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567229 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567370 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567539 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567690 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.567848 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.568164 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.568287 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.568482 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.568680 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.568812 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569022 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569116 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569351 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569443 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569711 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.569843 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570028 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570133 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570352 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570449 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570684 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.570969 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571068 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571288 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571380 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571604 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571693 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.571918 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572006 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572226 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572317 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572555 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572650 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572861 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.572964 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573167 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573256 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573481 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573571 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573828 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.573961 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.574211 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.574411 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.574536 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.574766 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.574893 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575088 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575177 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575412 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575499 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575726 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.575844 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576082 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576171 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576391 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576480 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576697 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.576795 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577019 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577107 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577323 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577409 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577629 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577759 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.577963 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578050 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578268 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578353 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578571 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578665 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578878 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.578965 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579187 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579282 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579491 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579585 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579802 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.579889 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580108 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580203 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580416 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580510 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580722 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.580822 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581028 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581114 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581335 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581423 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581648 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581802 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.581989 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582076 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582298 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582388 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582608 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582696 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.582914 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583004 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583226 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583313 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583534 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583627 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583849 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.583958 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584159 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584290 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584471 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584563 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584826 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.584964 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.585137 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.585223 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.585447 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.585755 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.585858 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586093 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586191 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586396 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586482 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586720 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.586807 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587034 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587130 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587349 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587436 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587657 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587744 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.587965 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588052 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588292 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588380 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588608 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588705 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.588925 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.589195 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.589334 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.589532 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.589679 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.589874 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590005 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590188 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590324 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590500 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590635 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590810 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.590945 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591121 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591266 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591428 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591628 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591828 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.591960 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.592148 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.592299 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.592461 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.592696 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.592829 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593078 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593213 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593430 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593565 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593763 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.593966 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594099 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594265 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594400 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594584 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594706 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.594914 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.595024 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.595227 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.595515 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.595832 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.596147 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.596462 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.596778 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.596863 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597125 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597222 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597459 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597559 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597819 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.597910 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598169 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598272 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598495 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598582 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598812 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.598898 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.599134 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.599450 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.599535 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.599764 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.599860 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600079 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600182 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600401 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600489 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600736 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.600833 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.601055 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.601150 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.601366 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.601462 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.601715 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602045 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602141 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602359 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602447 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602689 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.602776 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603034 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603129 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603347 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603441 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603682 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603769 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.603990 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604327 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604424 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604603 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604738 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.604918 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605034 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605241 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605411 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605564 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605662 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605902 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.605992 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606209 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606396 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606533 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606665 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606819 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.606968 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.607211 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.607405 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.607513 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.607824 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.607941 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608133 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608230 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608446 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608626 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608731 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.608864 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609044 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609175 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609355 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609446 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609661 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609782 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.609992 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610096 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610299 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610395 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610681 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610785 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.610924 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611024 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611232 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611329 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611542 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611642 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611853 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.611951 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612161 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612259 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612471 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612560 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612778 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.612876 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613090 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613193 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613401 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613539 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613733 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.613827 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614042 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614142 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614360 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614563 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614736 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.614898 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615054 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615297 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615547 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615691 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615821 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.615973 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616134 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616295 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616441 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616587 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.616996 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617147 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617292 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617430 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617603 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617804 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.617972 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618118 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618265 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618422 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618572 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618726 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618857 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.618989 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619121 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619267 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619404 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619562 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619710 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619852 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.619990 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620399 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620544 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620733 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.620902 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621048 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621213 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621363 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621522 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621716 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.621883 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622045 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622213 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622362 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622523 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622670 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.622879 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.623028 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.623298 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.623616 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.623930 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624086 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624241 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624414 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624622 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624772 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.624892 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625147 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625320 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625449 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625654 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.625795 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626015 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626102 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626384 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626538 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626684 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.626802 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627033 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627127 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627349 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627439 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627672 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627807 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.627989 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.628085 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.628299 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.628386 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.628545 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:57:17.628634 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.628984 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.629318 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.629638 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.629979 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.630338 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:17.630578 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:57:17.788834 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO dbcounter [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Registered counter for database nova_api Sep 07 12:57:17.795696 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Registered counter for database nova_api Sep 07 12:57:17.812053 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_db.sqlalchemy.engines [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.816625 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.819220 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writer thread running {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:17.823414 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:17.877959 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.context [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89(cell1) {{(pid=105790) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:57:17.880986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.context [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89(cell1) {{(pid=105791) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:57:17.882077 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.882607 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.884239 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.884878 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.884980 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.885351 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.885444 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.886974 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.887460 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_concurrency.lockutils [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.887699 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.888449 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.890103 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO dbcounter [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Registered counter for database nova_cell0 Sep 07 12:57:17.890719 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.892860 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Registered counter for database nova_cell0 Sep 07 12:57:17.894326 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO dbcounter [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Registered counter for database nova_cell1 Sep 07 12:57:17.897094 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Registered counter for database nova_cell1 Sep 07 12:57:17.903047 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_db.sqlalchemy.engines [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.904443 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_db.sqlalchemy.engines [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.905692 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.909025 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:17.910621 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writer thread running {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:17.911707 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:17.916155 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writer thread running {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:18.064889 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:18.065600 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO dbcounter [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Registered counter for database nova_cell0 Sep 07 12:57:18.074114 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG oslo_db.sqlalchemy.engines [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:18.078456 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Registered counter for database nova_cell0 Sep 07 12:57:18.079437 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writer thread running {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:18.089243 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:18.098359 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:18.423581 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:57:18.424723 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: WARNING keystonemiddleware.auth_token [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:57:18.431160 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:57:18.432052 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: WARNING keystonemiddleware.auth_token [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:57:18.774907 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: WARNING keystonemiddleware.auth_token [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:57:18.775776 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:57:18.781153 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: WARNING keystonemiddleware.auth_token [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:57:18.781907 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:57:18.786743 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562cde73f9c0 pid: 105790 (default app) Sep 07 12:57:18.787306 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562cde73f9c0 pid: 105791 (default app) Sep 07 12:57:18.788837 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:18.790072 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-435cc97f-def0-4a0a-969c-de8a1ce75359 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Sep 07 12:57:18.790490 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Sep 7 12:57:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:50.137296 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:50.138631 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Sep 07 12:58:50.139394 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:50.151678 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_api:SELECT=3 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.153787 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_cell0:SELECT=3 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.154659 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_cell1:SELECT=3 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.156628 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.120997 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c11982c8-466e-44b5-bb07-6ed1cb439840 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:51.154752 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-c11982c8-466e-44b5-bb07-6ed1cb439840 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.008651 Sep 07 12:58:51.157805 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 12:58:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:53.934198 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:53.935317 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9f472d65-0952-418f-abfd-e6bc9dea3c89 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Sep 07 12:58:53.936048 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:54.475275 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-25bb29d7-4f3b-4f05-9006-d322923d8c5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "swap": 0}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:54.544959 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-25bb29d7-4f3b-4f05-9006-d322923d8c5a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.601325 Sep 07 12:58:54.545769 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:58:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:58:54.560003 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.561164 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell0:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.562020 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell1:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.562662 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell0:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.767583 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-d8ae6a76-f567-45ba-bf8a-ce725bb7dc7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:54.835210 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-d8ae6a76-f567-45ba-bf8a-ce725bb7dc7d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280548 Sep 07 12:58:54.835766 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 12:58:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:57.767218 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-25bb29d7-4f3b-4f05-9006-d322923d8c5a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:57.768236 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-25bb29d7-4f3b-4f05-9006-d322923d8c5a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 07 12:58:57.768934 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:58.556942 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-85d38d1a-36a4-4ea3-9461-b9b06ae2c7ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:58.601514 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-85d38d1a-36a4-4ea3-9461-b9b06ae2c7ae admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.825260 Sep 07 12:58:58.602401 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:58:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:58:58.615696 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-20ceca06-0067-4c16-8781-cb8506dc98e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:58.655447 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-20ceca06-0067-4c16-8781-cb8506dc98e6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044240 Sep 07 12:58:58.665729 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 12:58:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:01.361774 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-85d38d1a-36a4-4ea3-9461-b9b06ae2c7ae admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:01.362806 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-85d38d1a-36a4-4ea3-9461-b9b06ae2c7ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Sep 07 12:59:01.363221 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:01.871296 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-0145397a-9f3a-4b31-ad23-f35b7f6992d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "vcpus": 1}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:01.893806 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-0145397a-9f3a-4b31-ad23-f35b7f6992d4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523095 Sep 07 12:59:01.894697 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:01.908540 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-706f8c37-7e64-49e3-aefb-3998a5358c60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:01.936645 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-706f8c37-7e64-49e3-aefb-3998a5358c60 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032988 Sep 07 12:59:01.937244 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 12:59:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:04.564522 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-0145397a-9f3a-4b31-ad23-f35b7f6992d4 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:04.566248 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-0145397a-9f3a-4b31-ad23-f35b7f6992d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Sep 07 12:59:04.566635 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:05.071906 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-e7d3577d-f5ba-4895-91b1-f532084e9049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:05.096733 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-e7d3577d-f5ba-4895-91b1-f532084e9049 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523571 Sep 07 12:59:05.101862 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:59:05.110031 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-3102fb1c-6416-4ae5-a1dd-294ec1514c0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:05.137629 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-3102fb1c-6416-4ae5-a1dd-294ec1514c0c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030404 Sep 07 12:59:05.138259 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 12:59:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:07.892279 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-e7d3577d-f5ba-4895-91b1-f532084e9049 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:07.893320 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-e7d3577d-f5ba-4895-91b1-f532084e9049 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 07 12:59:07.893929 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:08.387348 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "disk": 20}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:08.412271 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511123 Sep 07 12:59:08.412891 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:08.425374 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-f361b3cb-b63e-4913-bf83-1f747896d079 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:08.452920 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-f361b3cb-b63e-4913-bf83-1f747896d079 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030955 Sep 07 12:59:08.453848 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 12:59:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:11.166029 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:11.167162 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 07 12:59:11.167490 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:11.736589 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-5e28d8a3-0f7a-47fb-9467-5d1b6cbd20f4 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:11.791258 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-5e28d8a3-0f7a-47fb-9467-5d1b6cbd20f4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.614482 Sep 07 12:59:11.791838 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 12:59:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:59:14.563747 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:14.564749 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-c638d064-c449-4b70-bc73-a0589d52be46 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 07 12:59:14.565124 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:15.008957 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-832d2158-460b-4e7a-8f7c-d74542e1fbff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:15.028877 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-832d2158-460b-4e7a-8f7c-d74542e1fbff admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457343 Sep 07 12:59:15.029445 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:15.041714 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-4830f219-d3a8-4a10-ac07-31a5c084b81a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:15.071525 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-4830f219-d3a8-4a10-ac07-31a5c084b81a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033507 Sep 07 12:59:15.072349 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 12:59:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:17.689650 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-832d2158-460b-4e7a-8f7c-d74542e1fbff admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:17.690765 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-832d2158-460b-4e7a-8f7c-d74542e1fbff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 07 12:59:17.691174 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:18.130788 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-cd9d80d7-10c8-45ed-9025-c19d6b46b55f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "2", "vcpus": 1, "name": "m1.small"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:18.151525 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-cd9d80d7-10c8-45ed-9025-c19d6b46b55f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454016 Sep 07 12:59:18.152079 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:18.164543 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-8e7af3a6-2835-4a55-b323-b5e205f02495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:18.190424 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-8e7af3a6-2835-4a55-b323-b5e205f02495 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029723 Sep 07 12:59:18.191339 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 12:59:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:20.945710 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-cd9d80d7-10c8-45ed-9025-c19d6b46b55f admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:20.947464 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-cd9d80d7-10c8-45ed-9025-c19d6b46b55f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Sep 07 12:59:20.947842 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:21.482678 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-6f3273ba-d352-4ab9-9de9-2781a2bd995a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:21.502302 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-6f3273ba-d352-4ab9-9de9-2781a2bd995a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.543391 Sep 07 12:59:21.502949 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:21.515208 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-796c46e6-fdbd-4c2f-a1fb-4ec555589fbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:21.520768 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:21.545064 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-796c46e6-fdbd-4c2f-a1fb-4ec555589fbc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032706 Sep 07 12:59:21.565731 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 12:59:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:24.261266 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-6f3273ba-d352-4ab9-9de9-2781a2bd995a admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:24.262466 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-6f3273ba-d352-4ab9-9de9-2781a2bd995a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Sep 07 12:59:24.262868 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:24.855897 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-31434fb0-ba81-48d6-afb1-9db248582ddf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "vcpus": 4}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:24.882035 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-31434fb0-ba81-48d6-afb1-9db248582ddf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.612270 Sep 07 12:59:24.894631 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:59:24.907121 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9d038884-795d-44c5-99a2-5cb7e442f730 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:24.917890 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.952009 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9d038884-795d-44c5-99a2-5cb7e442f730 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052361 Sep 07 12:59:24.952789 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 12:59:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:27.679330 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-31434fb0-ba81-48d6-afb1-9db248582ddf admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:27.680341 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-31434fb0-ba81-48d6-afb1-9db248582ddf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Sep 07 12:59:27.680902 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:28.213505 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:28.233286 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.546291 Sep 07 12:59:28.234054 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 12:59:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:28.246443 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-130f038b-331b-4ac2-97cc-89efe5f54b34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:28.272476 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-130f038b-331b-4ac2-97cc-89efe5f54b34 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029661 Sep 07 12:59:28.273174 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 12:59:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:45.014697 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:45.015617 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 07 12:59:45.016069 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 12:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:45.027960 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.432690 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9bc4a871-4f22-4371-b19a-ca3dad5f351b admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:45.451892 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9bc4a871-4f22-4371-b19a-ca3dad5f351b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428590 Sep 07 12:59:45.452422 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 12:59:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:59:46.791577 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.792616 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-dedd0dfb-d0b8-45fe-be42-d0c4cdcfa5da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 07 12:59:46.793061 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:47.347728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-0279cbcb-9627-4436-b994-81f3713c9f12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.353770 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.wsgi [None req-0279cbcb-9627-4436-b994-81f3713c9f12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-0279cbcb-9627-4436-b994-81f3713c9f12 admin admin] Request method failure captured: Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept: application/json Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept-Encoding: gzip, deflate Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Connection: keep-alive Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Content-Length: 0 Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Host: 10.222.0.17 Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-System-Scope: None Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: User-Agent: python-novaclient Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Auth-Token: gAAAAABjGJXCjWXmK9NVTlfEGmbE4rGlBpNd0BTbu9KBNa0kxX37P2PEESE_z6JExXPtnaNlfU8oZcx2rqZEcsRctQ_gyDO9bpOrgpV9plA_NIA1xAEW8O1LRzRzdU71UjGulmFejivFeEphuTpWXFqSBMZ4HaEYCrIRTLb2g2i1ygV4SAb5clQ Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Id: None Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Name: None Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Identity-Status: Confirmed Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Is-Admin-Project: True Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Id: default Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Name: Default Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Name: admin Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Role: reader,member,admin Sep 07 12:59:47.357087 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Roles: reader,member,admin Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant: admin Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Name: admin Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User: admin Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Id: default Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Name: Default Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Name: admin Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: method: > Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: exception: Flavor 42 could not be found. Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: action_args: {'id': '42'} Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.358722 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.359630 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.360758 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-0279cbcb-9627-4436-b994-81f3713c9f12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.361831 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-0279cbcb-9627-4436-b994-81f3713c9f12 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.428717 Sep 07 12:59:47.361831 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:47.368915 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-ad0dcd2d-93bd-4d2b-87fa-6cba21ec3755 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.373121 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:47.394425 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-ad0dcd2d-93bd-4d2b-87fa-6cba21ec3755 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029258 Sep 07 12:59:47.395028 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:47.405632 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-8e5d6009-fa06-4489-8ae0-c62a4eee4160 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.428728 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-8e5d6009-fa06-4489-8ae0-c62a4eee4160 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026738 Sep 07 12:59:47.429298 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:47.440900 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b9cecca8-5969-4727-9d7c-4873b69a7285 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.447699 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-b9cecca8-5969-4727-9d7c-4873b69a7285 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b9cecca8-5969-4727-9d7c-4873b69a7285 admin admin] Request method failure captured: Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept: application/json Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Connection: keep-alive Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Content-Length: 0 Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Host: 10.222.0.17 Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABjGJXCjWXmK9NVTlfEGmbE4rGlBpNd0BTbu9KBNa0kxX37P2PEESE_z6JExXPtnaNlfU8oZcx2rqZEcsRctQ_gyDO9bpOrgpV9plA_NIA1xAEW8O1LRzRzdU71UjGulmFejivFeEphuTpWXFqSBMZ4HaEYCrIRTLb2g2i1ygV4SAb5clQ Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Role: reader,member,admin Sep 07 12:59:47.451175 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Roles: reader,member,admin Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant: admin Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User: admin Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Name: admin Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: method: > Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: exception: Flavor 42 could not be found. Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: action_args: {'id': '42'} Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.452768 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.453916 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.455613 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b9cecca8-5969-4727-9d7c-4873b69a7285 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.457324 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b9cecca8-5969-4727-9d7c-4873b69a7285 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015420 Sep 07 12:59:47.457324 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:48.704723 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-8e5d6009-fa06-4489-8ae0-c62a4eee4160 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:48.705785 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-8e5d6009-fa06-4489-8ae0-c62a4eee4160 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 07 12:59:48.706187 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:49.318799 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-842d27c1-81d5-4b6b-919c-c2ccdb1ad385 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:49.324689 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-842d27c1-81d5-4b6b-919c-c2ccdb1ad385 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-842d27c1-81d5-4b6b-919c-c2ccdb1ad385 admin admin] Request method failure captured: Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept: application/json Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Connection: keep-alive Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Content-Length: 0 Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Host: 10.222.0.17 Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABjGJXErL_qdGWoi90Bdt1qtzTuYN19jErOUFWrPWxP2KemAPpXHbZZeOwFk6RdhD5-Y_hlzBXoxdjJHAzf84Ns9iaosmFhzw7oayyhnccymXUYMPmDOO91q_5e6D9rCsDEGgDVv2Jk145kkx8zwDFdlxaFfr08-6cjMO86vL7_UJyJNxU Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Role: reader,member,admin Sep 07 12:59:49.326399 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Roles: reader,member,admin Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant: admin Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User: admin Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Name: admin Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: method: > Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: exception: Flavor 84 could not be found. Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: action_args: {'id': '84'} Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:49.329986 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:49.331012 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.332250 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-842d27c1-81d5-4b6b-919c-c2ccdb1ad385 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:49.334230 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-842d27c1-81d5-4b6b-919c-c2ccdb1ad385 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.485948 Sep 07 12:59:49.334230 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 12:59:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 487 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:49.339505 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-8757b747-429a-408e-9b5e-ddfcae18a9e7 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:49.356047 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-8757b747-429a-408e-9b5e-ddfcae18a9e7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020383 Sep 07 12:59:49.356643 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:49.367438 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-11bf9dc9-60c4-4787-9336-c2a3a274abfb admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:49.383310 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-11bf9dc9-60c4-4787-9336-c2a3a274abfb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019822 Sep 07 12:59:49.383906 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:49.394513 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c04633dd-4568-480e-a4ad-d74338960a16 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:49.400875 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.wsgi [None req-c04633dd-4568-480e-a4ad-d74338960a16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c04633dd-4568-480e-a4ad-d74338960a16 admin admin] Request method failure captured: Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept: application/json Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept-Encoding: gzip, deflate Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Connection: keep-alive Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Content-Length: 0 Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Host: 10.222.0.17 Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-System-Scope: None Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: User-Agent: python-novaclient Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Auth-Token: gAAAAABjGJXErL_qdGWoi90Bdt1qtzTuYN19jErOUFWrPWxP2KemAPpXHbZZeOwFk6RdhD5-Y_hlzBXoxdjJHAzf84Ns9iaosmFhzw7oayyhnccymXUYMPmDOO91q_5e6D9rCsDEGgDVv2Jk145kkx8zwDFdlxaFfr08-6cjMO86vL7_UJyJNxU Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Id: None Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Name: None Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Identity-Status: Confirmed Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Is-Admin-Project: True Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Id: default Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Name: Default Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Name: admin Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Role: reader,member,admin Sep 07 12:59:49.402432 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Roles: reader,member,admin Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant: admin Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Name: admin Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User: admin Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Id: default Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Name: Default Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Name: admin Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: method: > Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: exception: Flavor 84 could not be found. Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: action_args: {'id': '84'} Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:49.404015 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:49.404836 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:49.406001 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-c04633dd-4568-480e-a4ad-d74338960a16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:49.407022 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-c04633dd-4568-480e-a4ad-d74338960a16 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013615 Sep 07 12:59:49.407022 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 12:59:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:50.690631 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-11bf9dc9-60c4-4787-9336-c2a3a274abfb admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:50.691633 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-11bf9dc9-60c4-4787-9336-c2a3a274abfb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 07 12:59:50.692050 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:51.246366 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-3b1c6d8e-dd0d-4547-8aef-8fb995e6e198 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:51.252782 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.wsgi [None req-3b1c6d8e-dd0d-4547-8aef-8fb995e6e198 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-3b1c6d8e-dd0d-4547-8aef-8fb995e6e198 admin admin] Request method failure captured: Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept: application/json Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Accept-Encoding: gzip, deflate Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Connection: keep-alive Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Content-Length: 0 Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Host: 10.222.0.17 Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Openstack-System-Scope: None Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: User-Agent: python-novaclient Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Auth-Token: gAAAAABjGJXGCj9ckAFtKkbI7ZVL_SrdAvtmbc9X079EkfVAJ51nvuzFbOw1kw5mJuc5ZlfII6JQULhijpV5P7Plh1l_bNMeE50miSl8WmI5HRxBYbEn5DuQpXePuZ-sl9HoAzj_Wh-g91PJIqqsm-vggX3Uq84VNgNmPfAnOkOXXgb-KcfEzSE Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Id: None Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Domain-Name: None Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Identity-Status: Confirmed Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Is-Admin-Project: True Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Id: default Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Domain-Name: Default Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Project-Name: admin Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Role: reader,member,admin Sep 07 12:59:51.254388 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Roles: reader,member,admin Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant: admin Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-Tenant-Name: admin Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User: admin Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Id: default Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Domain-Name: Default Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: X-User-Name: admin Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: method: > Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: exception: Flavor 451 could not be found. Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: action_args: {'id': '451'} Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:51.256121 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:51.256973 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.258617 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-3b1c6d8e-dd0d-4547-8aef-8fb995e6e198 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:51.259912 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-3b1c6d8e-dd0d-4547-8aef-8fb995e6e198 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.429299 Sep 07 12:59:51.259912 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 12:59:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:51.266532 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-c0b1fa82-f0e4-404f-afb6-ff7e8e94dd2a admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:51.283283 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-c0b1fa82-f0e4-404f-afb6-ff7e8e94dd2a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020183 Sep 07 12:59:51.284230 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:51.294578 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:51.310573 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019726 Sep 07 12:59:51.311124 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 12:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:51.320988 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-32202221-79cd-445a-b670-e309a8f931cb admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:51.326578 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-32202221-79cd-445a-b670-e309a8f931cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-32202221-79cd-445a-b670-e309a8f931cb admin admin] Request method failure captured: Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept: application/json Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Connection: keep-alive Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Content-Length: 0 Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Host: 10.222.0.17 Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.92 Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABjGJXGCj9ckAFtKkbI7ZVL_SrdAvtmbc9X079EkfVAJ51nvuzFbOw1kw5mJuc5ZlfII6JQULhijpV5P7Plh1l_bNMeE50miSl8WmI5HRxBYbEn5DuQpXePuZ-sl9HoAzj_Wh-g91PJIqqsm-vggX3Uq84VNgNmPfAnOkOXXgb-KcfEzSE Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Role: reader,member,admin Sep 07 12:59:51.328087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Roles: reader,member,admin Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f6924cc44bdf49bd840f84494b6ffd4d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f6924cc44bdf49bd840f84494b6ffd4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant: admin Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Id: f6924cc44bdf49bd840f84494b6ffd4d Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User: admin Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Id: ca1f33becd334f89a27a7404e04ed5aa Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: X-User-Name: admin Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: method: > Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: exception: Flavor 451 could not be found. Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: action_args: {'id': '451'} Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:51.329602 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:51.330677 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Sep 07 12:59:51.332062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-32202221-79cd-445a-b670-e309a8f931cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:51.334194 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-32202221-79cd-445a-b670-e309a8f931cb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012151 Sep 07 12:59:51.334194 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 12:59:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:52.636064 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:52.636994 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 07 12:59:52.637387 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:53.191960 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-5652d717-dd32-41b9-ab3c-47e9f1da4c48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:53.212911 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-5652d717-dd32-41b9-ab3c-47e9f1da4c48 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.436489 Sep 07 12:59:53.213500 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 12:59:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:54.507538 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:54.508598 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 07 12:59:54.509009 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:55.063274 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-3a69c84a-ef8a-4309-976f-8f48ed3bbba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:55.085166 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-3a69c84a-ef8a-4309-976f-8f48ed3bbba5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.437652 Sep 07 12:59:55.085737 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 12:59:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:56.340908 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:56.341982 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 07 12:59:56.342378 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:56.900321 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-1652c795-72e6-44d3-aff2-b812f1e96b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:56.920900 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-1652c795-72e6-44d3-aff2-b812f1e96b19 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.441607 Sep 07 12:59:56.921472 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 12:59:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:58.212466 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:58.213517 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Sep 07 12:59:58.214039 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 12:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:58.798219 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-ffb5de89-665c-4248-8322-e27bc1ca48fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:58.822567 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-ffb5de89-665c-4248-8322-e27bc1ca48fb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.471210 Sep 07 12:59:58.823136 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 12:59:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:00.094580 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:00.095591 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 07 13:00:00.095989 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 13:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:00.644884 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-14d4b4d3-d28b-461f-b2c8-48a208e0abc0 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:00.666196 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-14d4b4d3-d28b-461f-b2c8-48a208e0abc0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.435209 Sep 07 13:00:00.666811 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Sep 7 13:00:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:00.448870 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.449924 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-58b9ddd4-99ae-4b4b-ba7c-f25151231c12 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 07 13:01:00.450327 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:00.462967 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:00.884689 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-722dba94-d995-4bc4-86d5-1409e2c450de admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.906629 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-722dba94-d995-4bc4-86d5-1409e2c450de admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.449165 Sep 07 13:01:00.907178 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:00.930019 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG dbcounter [-] [105790] Writing DB stats nova_api:SELECT=14 {{(pid=105790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:00.934343 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-4a1c7b92-3e1f-47d9-bcf7-1d8904b73b85 admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.942445 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-4a1c7b92-3e1f-47d9-bcf7-1d8904b73b85 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013810 Sep 07 13:01:00.943027 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:01:00.955598 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-838bfa3e-a2e0-4c31-8af9-fbaf318f01b5 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.964062 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-838bfa3e-a2e0-4c31-8af9-fbaf318f01b5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012113 Sep 07 13:01:00.964626 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:01:00.977554 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.986616 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012686 Sep 07 13:01:00.987177 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:01:00.999405 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-0b8b9333-d06f-4226-82d5-4a782d4798ae admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:01.007341 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-0b8b9333-d06f-4226-82d5-4a782d4798ae admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011706 Sep 07 13:01:01.007887 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:10.046234 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:10.047361 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Sep 07 13:04:10.047764 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:10.196183 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=6 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:10.367213 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:10.370790 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.371321 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.371744 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.372460 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.372926 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.373335 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.409454 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-8b94f8cd-f924-4e18-9e4b-325e60384584 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.214574 Sep 07 13:04:10.410240 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 13:04:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:11.495287 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:11.496290 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 07 13:04:11.496702 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:11.692353 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:11.695870 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:11.696341 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:11.696816 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:11.697463 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:11.697937 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:11.698342 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:11.718234 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-afbc87cc-4b6a-4615-b13f-eaa756746b98 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081485 Sep 07 13:04:11.718793 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 13:04:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:23.287825 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:23.288844 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 07 13:04:23.289233 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:23.448486 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell0:SELECT=4 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:23.449147 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell1:SELECT=4 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:23.450076 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=8 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:23.504623 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:23.506318 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:23.506946 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:23.507566 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:23.508348 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:23.509087 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:23.509614 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:23.539158 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9ba87ddf-f0c2-4f24-8d88-9d9543ceea48 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.095070 Sep 07 13:04:23.539848 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 13:04:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:04:24.658954 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: DEBUG nova.api.openstack.wsgi [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] Calling method '>' {{(pid=105790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:24.659984 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: INFO nova.api.openstack.requestlog [None req-9f70272e-58ed-41cd-8678-ef44baaf930a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 07 13:04:24.660390 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: [pid: 105790|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:24.854023 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:24.857533 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:24.858043 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:24.858511 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:24.859231 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:24.859646 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:24.860057 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:24.883137 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-7b0baae3-bb35-4de6-96e9-801035bb5b59 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086583 Sep 07 13:04:24.883708 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 13:04:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:05:25.397557 dv-cinder-853315-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 13:05:25.398315 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: Wed Sep 7 13:05:25 2022 - graceful shutdown triggered... Sep 07 13:05:25.398812 dv-cinder-853315-7-iscsi devstack@n-api.service[105791]: Gracefully killing worker 2 (pid: 105791)... Sep 07 13:05:25.399295 dv-cinder-853315-7-iscsi devstack@n-api.service[105790]: Gracefully killing worker 1 (pid: 105790)... Sep 07 13:05:26.399360 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: worker 1 buried after 1 seconds Sep 07 13:05:26.399360 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: worker 2 buried after 1 seconds Sep 07 13:05:26.399360 dv-cinder-853315-7-iscsi devstack@n-api.service[105789]: goodbye to uWSGI. Sep 07 13:05:26.401064 dv-cinder-853315-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 13:05:26.401693 dv-cinder-853315-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 13:05:26.404555 dv-cinder-853315-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:05:26.417539 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:05:26 2022] *** Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: nodename: dv-cinder-853315-7-iscsi Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: machine: x86_64 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: clock source: unix Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: pcre jit disabled Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: detected number of CPU cores: 4 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: current working directory: / Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: your processes number limit is 47680 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: your memory page size is 4096 bytes Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: detected max file descriptor number: 2048 Sep 07 13:05:26.420354 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: lock engine: pthread robust mutexes Sep 07 13:05:26.421355 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: thunder lock: enabled Sep 07 13:05:26.421355 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:05:26.421355 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:05:26.461536 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: Python main interpreter initialized at 0x560d7ee059c0 Sep 07 13:05:26.461536 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: python threads support enabled Sep 07 13:05:26.461536 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: your server socket listen backlog is limited to 100 connections Sep 07 13:05:26.461536 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:05:26.462026 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:05:26.462110 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: *** Operational MODE: preforking *** Sep 07 13:05:26.462385 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:05:26.462385 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: spawned uWSGI master process (pid: 120800) Sep 07 13:05:26.462583 dv-cinder-853315-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:05:26.469731 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: spawned uWSGI worker 1 (pid: 120817, cores: 1) Sep 07 13:05:26.469731 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: spawned uWSGI worker 2 (pid: 120818, cores: 1) Sep 07 13:05:26.469731 dv-cinder-853315-7-iscsi devstack@n-api.service[120800]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:05:27.156270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:05:27.160215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:05:28.351661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:28.351661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: from cryptography.utils import int_from_bytes Sep 07 13:05:28.352768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:28.352768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: from cryptography.utils import int_from_bytes Sep 07 13:05:28.404646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:28.404646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: from cryptography.utils import int_from_bytes Sep 07 13:05:28.405261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:05:28.405261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: from cryptography.utils import int_from_bytes Sep 07 13:05:30.798839 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:05:30.799664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:05:30.799664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:05:30.800122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:05:30.800321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:05:30.800650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.800979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.801310 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.801625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.801977 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.802275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.802605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.802927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.803251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.803504 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.803815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.804299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-7-iscsi {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.804815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.805132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.805442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.805803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.806141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.806517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.806812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.807304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.808079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.808391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.808808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.809158 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.809479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.809825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.810159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.810496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.810843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.811177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.811497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-7-iscsi {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.811822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.812166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.812592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.812995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.813444 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.813444 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.814199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.814199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.814990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.814990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.815475 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.815475 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.815905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.816181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.816452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.816654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.816892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.817193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.817497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.817871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.818524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.818848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.819206 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.819565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.819818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.820063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.820479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.820799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.821107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.821412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.821749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.822061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.822368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.822674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.822979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.823283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.823601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.823914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.824263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.824542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.824882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.825287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.825500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.825865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.826203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.826518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.826828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.827129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.827432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.827737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.828040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.828342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.831353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.831711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.832019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.832259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.832588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.832896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.833207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.833517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.833846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.834153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.834439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.834761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.835065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.835390 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.835673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.835975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.836277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.836584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.836886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.837188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.837498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.837829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.838221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.838532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.838765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.839654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.839654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.839654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.840126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.840280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.840525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.840833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.841135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.841449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.841780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.842107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.842407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.842696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.843015 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.843326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.843630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.843931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.844232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.844525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.844811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.845124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.845422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.845800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.846071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.846534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.847152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.847408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.847718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.848122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.848389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.848754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.849457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.849457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.849814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.850123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.850449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.850768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.851078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.851391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.851714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.852022 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.852333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.856205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.857519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.858793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.858793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.858793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.858793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.859399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.859399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.859727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.859891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.861929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.862276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.862785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.863073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.863396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.863714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.864014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.864333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.867349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.868759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.869683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.869683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.869683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.870130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.870130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.871501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.871501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.871501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.871501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.872080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.872080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.872360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.872512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.872726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.873033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.873342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.873650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.873992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.874306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.874613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.874947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.875279 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.875582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.875904 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.876228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.876542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.876843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.877844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.877844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.877844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.878326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.878591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.878754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.878983 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.879285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.879588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.879889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.880210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.880776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.881798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.881798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.881798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.881798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.882361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.882512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.882773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.883082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.883405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.883717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.884032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.884339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.884649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.884959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.885269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.885589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.885928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.886246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.886554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.886875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.887850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.888673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.889176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.889761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.890362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.891018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.892006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.892171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.892895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.893378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.893996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.894566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.895119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:05:30.895638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.895797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:05:30.895952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.896107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:05:30.896292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.896458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:05:30.896604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:05:30.896876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.897040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.897289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.897459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.897784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.897980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.898142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.898295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.898545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.898696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.898901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.899172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.899334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.899497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.899739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.899892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.900080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.900337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.900552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-7-iscsi {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.900875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.901211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.901566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.901566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.902351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.902508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.902508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.902802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.902948 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.903102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.903265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.903265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.903584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.903741 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.903888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.904030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.904182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.904416 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.904574 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.904731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.905002 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.905162 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.905314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.905544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.905743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.905975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.906131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.906287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.906432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.906677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-7-iscsi {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.906843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.907087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.907295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.907454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.907609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.907960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.908135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.908367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.908575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.908735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.909090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.909264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.909422 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.909603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.909810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.910096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.910266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.910428 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.910584 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.910932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.911128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.911470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.911802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.912531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.912531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.912531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.912531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.912836 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.912999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.912999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.913134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.913206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.913483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.913619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.913841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.914164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.914329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.914489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.914641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.914813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.914965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.915111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.915264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.915422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.915567 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.915727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.915881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.916049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.916210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.916366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.916522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.916675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.916828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.917079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.917231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.917383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.917553 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.917903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.918072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.918220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.918363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.918517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.918672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.918826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.919027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.919176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.919328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.919481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.919637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.919637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.919954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.919954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.920236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.920388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.920542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.920697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.920843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.920995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.921139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.921298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.921624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.921968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.922223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.922528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.922694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.922857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.923011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.923166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.923319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.923473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.923625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.923781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.924001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.924751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.924922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.925079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.925232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.925389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.925535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.925778 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.925932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.926089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.926248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.926405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.926405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.926679 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.926832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.926989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.927148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.927293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.927437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.927588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.927734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.927893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.928048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.928192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.928343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.928343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.928640 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.928785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.928947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.929148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.929304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.929463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.929608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.929796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.929943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.930100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.930254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.930410 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.930565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.930719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.930881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.931040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.931193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.931193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.931540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.931853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.932209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.932458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.932796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.932946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.933091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.933244 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.933406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.933653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.934576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.934757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.934923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.935136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.935293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.935446 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.935603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.935748 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.935902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.936056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.936210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.936356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.936523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.936677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.936830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.936984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.937130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.937130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.937404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.937558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.937736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.937906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.938052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.938206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.938360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.938525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.938832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.939010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.939219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.939371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.939571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.939760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.939921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.940077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.940231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.940377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.940521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.940685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.940853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.941005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.941158 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.941348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.941507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.941653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.942030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.942379 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.942647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.942977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.943129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.943284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.943450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.943597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:05:30.943749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.943901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.944951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.945910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.946953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947574 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.947878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.948943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.949943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.950996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.951281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.951445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.951591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.951736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.951887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.952189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.952522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.952762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.953909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.954989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.955986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.956897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.957856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.958913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959726 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.959872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.960962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.961912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.962069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.962362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.962679 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.962922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.963245 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.963411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.963559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.963713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.963866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964021 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.964967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.965775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.965945 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.966875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.967984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968449 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.968920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.969092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.969253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.969467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.969633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.969913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.970961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.971982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.972153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.972153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.972840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.973099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.973456 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.973634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.973825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.974982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975940 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.975940 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.976250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.976419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.976579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.976739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.976899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.977907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.978071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.978235 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.978471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.978634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.978787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.979439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.979912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.980068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.980235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.980397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.980558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.980558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.981297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.981780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.981963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.981963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.982995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983671 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.983962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.984926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.985992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986384 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.986884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987386 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.987832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988626 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.988984 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.989958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990496 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990874 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.990968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.991967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.992889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.993911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.994913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995597 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.995958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996054 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996904 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.996993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.997985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.998913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999093 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999553 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:30.999996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.000969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001372 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.001561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.002280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.002455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.002624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.002624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.003282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.003446 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.003607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.003919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.004791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.005098 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.005210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.005405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.005506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.005741 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.006972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.007915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.008936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.009878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.010130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.010465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.010615 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.010785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.010952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.011903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.012919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.013172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.013289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.013718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.014960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.015885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.016835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017133 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.017877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.018985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.019078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.019303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.019615 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.019698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.019921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020370 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.020968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021484 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.021939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.022849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.023764 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.024979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.025178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.025405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.025513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.025811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.025922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026748 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.026851 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.027982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.028891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.029911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.030842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031614 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.031913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032826 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.032930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.033887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.034869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.035800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036008 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036705 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.036913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037854 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.037966 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.038925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.039090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.039196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.039396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.039490 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.039700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.040945 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.041996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042294 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.042914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.043835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.044952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.045892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.046924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.047893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.048827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049133 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.049959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050370 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.050905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051820 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.051940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052446 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052576 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.052884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.053933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.054910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.055867 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.056951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.057060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.057838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.057956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058604 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.058960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.059976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.060876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061212 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061726 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.061837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.062926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.063931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.064150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.064246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.064495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.064660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.064791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.065914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.066974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067291 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.067919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.068828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.069993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.070944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071874 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.071967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.072890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.073821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.074794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.075962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076169 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076597 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.076892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077202 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077558 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077730 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.077843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.078916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:05:31.079018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.079303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.079619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.079932 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.080344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.080664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.080977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.081291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.081606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.081967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.082283 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.082599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.082924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.083481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.083803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.084117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.084430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.084747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.085058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.085371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.085695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.086011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.086323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.086632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.086964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.087282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.087605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.087942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.088259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.088573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.088886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.089199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.089556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.089903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.090213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.090525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.090840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.091152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.091463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.091775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.092087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.092418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.092757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.093016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.093328 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.093644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.094039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.094319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.094640 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.094957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.095273 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.095588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.096161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.096478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.096807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.097130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.097452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.097796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.098116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.098441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.098745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.099050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.099358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.099668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.099971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.100295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.100645 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.100902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.101220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.101527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.102085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.102437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.102756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.103083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.103409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.103727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.104039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.104363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.104690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.104984 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.105313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.105613 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.105942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.106250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.106562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.106898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.107178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.107486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.107788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.108113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.108416 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.108720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.109023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.109337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.109637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.109960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.110267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.110570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.110880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.111182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.111686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.112020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.112333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.112694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.113006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.113309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.113629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.113963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.114349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.114586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.114898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.115225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.115538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.115848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.116197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.116513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.117057 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.117390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.117727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.118058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.118577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.118887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.119193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.119499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.119823 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.120136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.120453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.120794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.121076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.121382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.121710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.122023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.122333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.122643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.122952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.123262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.123570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.123879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.124187 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.124503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.124842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.125250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.125477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.125816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.126136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.126447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.126766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.127199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.127528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.127846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.128181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.128497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.128805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.129234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.129548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.129900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.130229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.130540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.130895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.131216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.131508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.131906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.132150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.132479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.132813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.133142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.133464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.133778 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.134101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.134377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.134680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.135018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.135350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.135635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.135909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.136225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.136524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.136825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.137129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.137430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.137752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.138057 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.138640 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.138965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.139249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.139549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.139849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.140153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.140391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Registered counter for database nova_api Sep 07 13:05:31.140520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.140747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.141046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.141347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.141647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.141997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.142329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.142764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.143214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.143480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.143801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.144113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.144436 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.144757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.145074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.145382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.145737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.146116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.146360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.146677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.146990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.147299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.147610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.147939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.148266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.148572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.148897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.149215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.149536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.149877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.150200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.150525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.150838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.151148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.151456 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.151767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.152076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.152393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.152700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.153036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.153352 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.153662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.154012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.154334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.154642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.154963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.155519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:05:31.160511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:05:31.161950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.169525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.220197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO dbcounter [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Registered counter for database nova_api Sep 07 13:05:31.227803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.context [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89(cell1) {{(pid=120818) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:05:31.231911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.232396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.234023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:31.234754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.235208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.237268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:31.239391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Registered counter for database nova_cell0 Sep 07 13:05:31.240917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_db.sqlalchemy.engines [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.243624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Registered counter for database nova_cell1 Sep 07 13:05:31.248907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writer thread running {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.251646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.255128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.258174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.307419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.context [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89(cell1) {{(pid=120817) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:05:31.311410 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.311884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.313488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:31.314240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.314802 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.316801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:31.318853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO dbcounter [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Registered counter for database nova_cell0 Sep 07 13:05:31.322990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO dbcounter [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Registered counter for database nova_cell1 Sep 07 13:05:31.331096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_db.sqlalchemy.engines [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.333438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_db.sqlalchemy.engines [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.338620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writer thread running {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.340798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writer thread running {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.405329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.415511 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO dbcounter [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Registered counter for database nova_cell0 Sep 07 13:05:31.422487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_db.sqlalchemy.engines [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.427829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writer thread running {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.492838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO dbcounter [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Registered counter for database nova_cell0 Sep 07 13:05:31.502213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_db.sqlalchemy.engines [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:05:31.507767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writer thread running {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:05:31.746197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:05:31.754724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:05:31.825375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: WARNING keystonemiddleware.auth_token [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:05:31.832880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: WARNING keystonemiddleware.auth_token [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:05:32.105559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:05:32.112544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: WARNING keystonemiddleware.auth_token [None req-115dca16-d1ec-4e51-9d56-afea915962ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:05:32.117980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d7ee059c0 pid: 120818 (default app) Sep 07 13:05:32.182612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: WARNING keystonemiddleware.auth_token [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:05:32.189603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: WARNING keystonemiddleware.auth_token [None req-23d9a013-6b66-4f70-a6ab-0325581a3ab1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:05:32.195696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d7ee059c0 pid: 120817 (default app) Sep 07 13:06:11.218738 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:11.219368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:11.223482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:11.225590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:13.247696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb467e1e-29c6-406b-8478-a0f5ec6e155f tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Action: 'create', calling method: .version_select at 0x7fdc42e76430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-862883095"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:15.647100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb467e1e-29c6-406b-8478-a0f5ec6e155f tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.446225 Sep 07 13:06:15.649118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Sep 7 13:06:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:06:15.673287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:15.675018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:15.678800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:15.680222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:16.138314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f555b58e-ff9e-4b8a-86d7-ea3272202cea tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42ebf0d0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:16.921832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f555b58e-ff9e-4b8a-86d7-ea3272202cea tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 200 len: 344 microversion: 2.1 time: 1.258015 Sep 07 13:06:16.922516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:06:15 2022] GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 344 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:17.938267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-867724ec-cd7a-4454-b104-e82972a478b0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42d48310>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:18.094681 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-867724ec-cd7a-4454-b104-e82972a478b0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 200 len: 345 microversion: 2.1 time: 0.160640 Sep 07 13:06:18.106171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:06:17 2022] GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:18.114625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8ad2b0f8-197c-4f48-837f-865e7e6f2cff tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Action: 'create', calling method: .version_select at 0x7fdc42d8a1f0>, body: {"snapshot": {"volume_id": "a46d7ba4-8247-4b31-addd-3ddbbeab2c39", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-935917700"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:18.396680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1776809326", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "networks": [{"uuid": "e1fec6aa-424f-47bc-bba3-d58c5dc06735"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:18.637068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] validate_networks() for [('e1fec6aa-424f-47bc-bba3-d58c5dc06735', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:06:18.659620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8ad2b0f8-197c-4f48-837f-865e7e6f2cff tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.551589 Sep 07 13:06:18.660579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 2/4] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Sep 7 13:06:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:18.671810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5b025c90-693b-496f-bff9-04726f206e4e tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42d45160>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:18.718399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5b025c90-693b-496f-bff9-04726f206e4e tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.050465 Sep 07 13:06:18.718993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:18 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:18.731127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b7a926b0-d8bc-43ca-8078-1518cf352aa0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42d45820>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:18.808044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b7a926b0-d8bc-43ca-8078-1518cf352aa0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.080628 Sep 07 13:06:18.808533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Sep 7 13:06:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:06:18.820306 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3c64eab0-3554-4a4f-9b4b-c1966dc41bc8 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42d45700>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:18.878406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3c64eab0-3554-4a4f-9b4b-c1966dc41bc8 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.061761 Sep 07 13:06:18.878990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 5/7] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:18 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:06:19.893641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-735370e4-aca6-4861-99e7-6920b69883ef tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42d8a160>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:20.075080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-735370e4-aca6-4861-99e7-6920b69883ef tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.186531 Sep 07 13:06:20.076180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 6/8] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:19 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:21.089193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a437c1ea-5106-4460-89c6-f94486b64015 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc436a23a0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:21.145454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a437c1ea-5106-4460-89c6-f94486b64015 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.060705 Sep 07 13:06:21.151642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 7/9] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:21 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:22.290508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:06:22.292314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:06:22.292975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:06:22.293550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:06:22.294132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:06:22.326978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:22.327707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:22.330944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1358057210", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:22.331775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:22.332874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:22.333519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:22.334187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:22.419232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Getting quotas for project 9a847ae68ca242c0bce510fd91c2633c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:22.432030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Getting quotas for user c0db39216fd24b5f9cb0531bcedb0326 and project 9a847ae68ca242c0bce510fd91c2633c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:22.465413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:06:22.471493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:06:22.662760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] validate_networks() for [('265b63b5-382d-4472-bef8-7754cbffccf7', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:06:22.678908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ec9d3b48-63ce-43dc-bbaa-5ba8f75738ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.561654 Sep 07 13:06:22.686985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 3/10] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:06:22.701824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3170a4b-5766-447f-ab26-d0a6062ef659 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc423e0ee0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:22.848943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3170a4b-5766-447f-ab26-d0a6062ef659 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.161302 Sep 07 13:06:22.849804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 4/11] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:22 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:22.860478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-970c4510-5298-45fd-92eb-99ca8441766a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:22.861623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-970c4510-5298-45fd-92eb-99ca8441766a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:23.276851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-970c4510-5298-45fd-92eb-99ca8441766a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:23.312034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-970c4510-5298-45fd-92eb-99ca8441766a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1215 microversion: 2.1 time: 0.454138 Sep 07 13:06:23.336531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 5/12] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:22 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1215 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:23.864663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d06b7205-26f9-4a92-9410-7b218ec2ea50 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc424113a0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:23.922461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d06b7205-26f9-4a92-9410-7b218ec2ea50 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.063662 Sep 07 13:06:23.924332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:23 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:24.054177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:06:24.054731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:06:24.055235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:06:24.055652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:06:24.056067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:06:24.079174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:24.080314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:24.081555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:24.082828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:24.083632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:24.084070 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:24.151170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:24.170147 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for user 3cad6d025da54eb29d09fd2a2888c844 and project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:24.191235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:06:24.198245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:06:24.329338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-31f94eb9-fd86-4cb0-8d70-e183dc51457a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.200239 Sep 07 13:06:24.330474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 8/14] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:06:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:06:24.342882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:24.343648 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:24.362606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:24.369877 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:24.372281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-07ce309d-898a-48eb-a679-7cef15b0ddc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:24.373871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07ce309d-898a-48eb-a679-7cef15b0ddc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:24.374148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:24.375162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:24.375872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:24.376914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:24.563236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-07ce309d-898a-48eb-a679-7cef15b0ddc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:24.607873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-07ce309d-898a-48eb-a679-7cef15b0ddc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1222 microversion: 2.1 time: 0.255749 Sep 07 13:06:24.608925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 9/15] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:24 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1222 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:24.703054 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1414074500", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:24.802027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:24.838516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] validate_networks() for [('265b63b5-382d-4472-bef8-7754cbffccf7', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:06:24.858672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f534cb9-d47e-493b-8389-790dc0a4403b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1219 microversion: 2.1 time: 0.514049 Sep 07 13:06:24.859644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 7/16] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:24 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1219 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:24.938140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bea2be37-3083-4fd7-9804-2fad9ff97eb3 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc4238bf70>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:25.026942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bea2be37-3083-4fd7-9804-2fad9ff97eb3 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.094068 Sep 07 13:06:25.028744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 8/17] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:24 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:06:25.890196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:25.891706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:25.927272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:25.929644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:25.930235 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:25.933333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:25.935449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:25.936326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:26.219954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:26.237019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-02e19d56-a21d-4f98-bdec-8186904f7384 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1267 microversion: 2.1 time: 0.356433 Sep 07 13:06:26.242194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 9/18] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:25 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:26.249563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-34fca0fc-7f23-4bf1-9882-bc2491a8d0d9 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc4232e3a0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:26.320620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-34fca0fc-7f23-4bf1-9882-bc2491a8d0d9 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 287 microversion: 2.1 time: 0.080618 Sep 07 13:06:26.321170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:26 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:26.336581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6c7fc522-983e-4e8e-8051-8f472d0c286f tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42350d30>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:26.484919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6c7fc522-983e-4e8e-8051-8f472d0c286f tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 202 len: 0 microversion: 2.1 time: 0.155150 Sep 07 13:06:26.490216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 11/20] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Sep 7 13:06:26 2022] DELETE /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:06:26.501599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eaec7732-8339-4758-8802-735e2ec812ea tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc422ea8b0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:26.638668 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eaec7732-8339-4758-8802-735e2ec812ea tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 200 len: 286 microversion: 2.1 time: 0.144249 Sep 07 13:06:26.639350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 12/21] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:26 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:27.266928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:27.270264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:27.286986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:27.288838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:27.290349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:27.291807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:27.293794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:27.296136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:27.339913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:06:27.341222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:06:27.342024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:06:27.342616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:06:27.343190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:06:27.373221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:27.373840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:27.381906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:27.386247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:27.388222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:27.391297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:27.451206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:27.464607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for user 3cad6d025da54eb29d09fd2a2888c844 and project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:27.505486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:06:27.507879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:06:27.639076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:27.656986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a82e2725-7d52-4465-817a-e1c785650e52 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1273 microversion: 2.1 time: 0.390235 Sep 07 13:06:27.661522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 13/22] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:27 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1273 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:27.668357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1eb8d569-878c-45be-8523-840a59a81bc6 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc422ea670>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:27.679091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-702bfa5d-95a0-46f3-9626-df9d4a7bc737 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.982571 Sep 07 13:06:27.681500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 10/23] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:06:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:06:27.702082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bceac872-1d86-4537-a65f-54691c3927ca tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:27.702716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bceac872-1d86-4537-a65f-54691c3927ca tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:27.778530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-1eb8d569-878c-45be-8523-840a59a81bc6 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] HTTP exception thrown: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1eb8d569-878c-45be-8523-840a59a81bc6 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Request method failure captured: Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 HTTP/1.1 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdDyTdSovbkPaIXqxOe8AQSxiZSBIqVuEPxf37jGTt2le8X_W3UnRR2Yj3H-pLN19jtWRcbSKWCx7t4zqh2bA8scwZE7XD2thtNNB_tfAWiizYs93YlrRw4yj0hUwexnYsGc-4tgsStvcZ4kSMjBFNXpaRtfFbOW1z5KxNkqHAXmr4 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:06:27.782923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a47e0b7cb9814ec1885f17bf3c37058b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: c3c51f18c0f34bddbcd17d984aafc91a Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '3763fc73-4830-4b82-bb59-0b3a190c9f89'} Sep 07 13:06:27.784569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. (HTTP 404) (Request-ID: req-c35b914d-ba52-41f3-99d9-17f1ce6ea224) Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.785418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:27.787013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 13:06:27.787952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1eb8d569-878c-45be-8523-840a59a81bc6 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Returning 404 to user: Snapshot 3763fc73-4830-4b82-bb59-0b3a190c9f89 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:06:27.788941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1eb8d569-878c-45be-8523-840a59a81bc6 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89" status: 404 len: 111 microversion: 2.1 time: 0.121754 Sep 07 13:06:27.793858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 14/24] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:06:27 2022] GET /compute/v2.1/os-snapshots/3763fc73-4830-4b82-bb59-0b3a190c9f89 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:06:27.828827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ec7cc6f-84e0-4c72-9978-1f50639e9b05 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc436a3940>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:28.169641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ec7cc6f-84e0-4c72-9978-1f50639e9b05 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 202 len: 0 microversion: 2.1 time: 0.374556 Sep 07 13:06:28.171206 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 15/25] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:06:27 2022] DELETE /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:06:28.192116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6dd24bfc-8264-4781-aecc-7c62a4328bf5 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc422ea9d0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:28.400942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6dd24bfc-8264-4781-aecc-7c62a4328bf5 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 200 len: 344 microversion: 2.1 time: 0.222807 Sep 07 13:06:28.412177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 16/26] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:06:28 2022] GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:28.648144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bceac872-1d86-4537-a65f-54691c3927ca tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:28.656815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bceac872-1d86-4537-a65f-54691c3927ca tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1222 microversion: 2.1 time: 0.967392 Sep 07 13:06:28.657381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:27 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1222 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:28.682008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:28.682638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:28.691645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:28.698763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:28.699232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:28.703077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:28.706342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:28.708737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:28.864946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:28.874091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05dd0a00-28dc-4076-8d33-a5095bca3d01 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1273 microversion: 2.1 time: 0.195882 Sep 07 13:06:28.874675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 17/28] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:28 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:29.417383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61fc256e-8e03-4b3f-b5f0-acd7b93e2bf0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc42417310>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:29.528782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-61fc256e-8e03-4b3f-b5f0-acd7b93e2bf0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] HTTP exception thrown: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61fc256e-8e03-4b3f-b5f0-acd7b93e2bf0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Request method failure captured: Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 HTTP/1.1 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdDyTdSovbkPaIXqxOe8AQSxiZSBIqVuEPxf37jGTt2le8X_W3UnRR2Yj3H-pLN19jtWRcbSKWCx7t4zqh2bA8scwZE7XD2thtNNB_tfAWiizYs93YlrRw4yj0hUwexnYsGc-4tgsStvcZ4kSMjBFNXpaRtfFbOW1z5KxNkqHAXmr4 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:06:29.545151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a47e0b7cb9814ec1885f17bf3c37058b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: c3c51f18c0f34bddbcd17d984aafc91a Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'a46d7ba4-8247-4b31-addd-3ddbbeab2c39'} Sep 07 13:06:29.546542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. (HTTP 404) (Request-ID: req-b91123d7-922d-4b66-a477-f9c47113c172) Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.547318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:29.548448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:06:29.549555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61fc256e-8e03-4b3f-b5f0-acd7b93e2bf0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Returning 404 to user: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:06:29.550766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-61fc256e-8e03-4b3f-b5f0-acd7b93e2bf0 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 404 len: 109 microversion: 2.1 time: 0.134712 Sep 07 13:06:29.566285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 12/29] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:06:29 2022] GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:06:29.569774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c2df3bd5-3a84-43c9-bf89-174b84124540 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc422ea790>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:29.625804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-c2df3bd5-3a84-43c9-bf89-174b84124540 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] HTTP exception thrown: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c2df3bd5-3a84-43c9-bf89-174b84124540 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Request method failure captured: Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 HTTP/1.1 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdDyTdSovbkPaIXqxOe8AQSxiZSBIqVuEPxf37jGTt2le8X_W3UnRR2Yj3H-pLN19jtWRcbSKWCx7t4zqh2bA8scwZE7XD2thtNNB_tfAWiizYs93YlrRw4yj0hUwexnYsGc-4tgsStvcZ4kSMjBFNXpaRtfFbOW1z5KxNkqHAXmr4 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:06:29.628731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a47e0b7cb9814ec1885f17bf3c37058b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: c3c51f18c0f34bddbcd17d984aafc91a Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a46d7ba4-8247-4b31-addd-3ddbbeab2c39'} Sep 07 13:06:29.630148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. (HTTP 404) (Request-ID: req-ba72e6a6-dbed-465d-bc51-7c57bd8899f2) Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.630976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:06:29.632192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:06:29.633338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.636808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.639436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c2df3bd5-3a84-43c9-bf89-174b84124540 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Returning 404 to user: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:06:29.643047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c2df3bd5-3a84-43c9-bf89-174b84124540 tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 404 len: 109 microversion: 2.1 time: 0.083026 Sep 07 13:06:29.656786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-303fc5ac-f573-4222-b29a-57caf40467ad tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Calling method '.version_select at 0x7fdc436a2790>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:29.661014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 18/30] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:06:29 2022] DELETE /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:06:29.687666 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:29.688715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:29.702315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:29.703082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:29.703705 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:29.704586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:29.706055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:29.706978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:29.756672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-303fc5ac-f573-4222-b29a-57caf40467ad tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] HTTP exception thrown: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-303fc5ac-f573-4222-b29a-57caf40467ad tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Request method failure captured: Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 HTTP/1.1 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdDyTdSovbkPaIXqxOe8AQSxiZSBIqVuEPxf37jGTt2le8X_W3UnRR2Yj3H-pLN19jtWRcbSKWCx7t4zqh2bA8scwZE7XD2thtNNB_tfAWiizYs93YlrRw4yj0hUwexnYsGc-4tgsStvcZ4kSMjBFNXpaRtfFbOW1z5KxNkqHAXmr4 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:06:29.761232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a47e0b7cb9814ec1885f17bf3c37058b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a47e0b7cb9814ec1885f17bf3c37058b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: a47e0b7cb9814ec1885f17bf3c37058b Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1332081681 Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: c3c51f18c0f34bddbcd17d984aafc91a Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1332081681-project Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'a46d7ba4-8247-4b31-addd-3ddbbeab2c39'} Sep 07 13:06:29.762670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. (HTTP 404) (Request-ID: req-4068959f-e501-48f6-bd80-0f15f7af9531) Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.763534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:06:29.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:06:29.766353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. Sep 07 13:06:29.767585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:06:29.770408 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-303fc5ac-f573-4222-b29a-57caf40467ad tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] Returning 404 to user: Volume a46d7ba4-8247-4b31-addd-3ddbbeab2c39 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:06:29.771522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-303fc5ac-f573-4222-b29a-57caf40467ad tempest-VolumesSnapshotsTestJSON-1332081681 tempest-VolumesSnapshotsTestJSON-1332081681-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39" status: 404 len: 109 microversion: 2.1 time: 0.120114 Sep 07 13:06:29.787891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 13/31] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:06:29 2022] GET /compute/v2.1/os-volumes/a46d7ba4-8247-4b31-addd-3ddbbeab2c39 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:06:29.904004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:29.904687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:29.920320 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:29.921228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:29.921909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:29.922799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:29.923474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:29.924194 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:30.083333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:30.100272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4034950f-2661-438c-aed4-8ad4b94884c7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1218 microversion: 2.1 time: 0.414450 Sep 07 13:06:30.102337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 19/32] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:29 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:30.486298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:30.527583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a851dd69-1627-4992-a069-8f9e6038e7fb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1273 microversion: 2.1 time: 0.630576 Sep 07 13:06:30.534898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 14/33] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:29 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1273 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:31.123701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:31.124331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:31.138062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:31.138741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:31.139109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:31.139824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:31.140573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:31.151273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:31.562950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:31.563761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:31.583763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:31.583763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:31.594174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:31.595096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:31.595582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:31.596037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:32.012861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:32.023975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6f062615-cdfd-4951-9a37-292103843775 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1218 microversion: 2.1 time: 0.903875 Sep 07 13:06:32.042714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 20/34] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:31 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1218 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:32.323812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:32.335329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9f7802ff-49f9-40c4-a642-139050d74037 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.776659 Sep 07 13:06:32.353060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 15/35] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:31 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:32.785595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:33.064317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:33.070776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:33.107578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:33.116417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:33.117489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:33.119070 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:33.120133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:33.121496 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:33.271913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f16f0f4a-08a7-44fb-8ab6-7c12f458af03 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: .version_select at 0x7fdc423aa0d0>, body: {"keypair": {"name": "tempest-keypair-1941015723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7p5kb6W63ep4PvhbjrATAoq+HTOQ527QseoITvWO2kwwuA3LHW1WFCUtNU455IZFZfktWN/DgkmhD/GqsyqNIe7qxJnJkaHLNz/cl9Hs/2Bige2B/ec8Id2wTc6V/Hgg=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:33.366889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:33.404295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-f16f0f4a-08a7-44fb-8ab6-7c12f458af03 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:33.421635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:33.423515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-f16f0f4a-08a7-44fb-8ab6-7c12f458af03 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:33.433899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4adc26e4-8ed8-4a5c-aebe-df2a0f7ce7bc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1218 microversion: 2.1 time: 0.378945 Sep 07 13:06:33.435076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 16/36] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:33 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1218 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:33.454047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:33.454895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:33.487531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:33.489055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:33.491712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:33.498603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:33.499282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:33.500792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:33.592107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f16f0f4a-08a7-44fb-8ab6-7c12f458af03 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.808468 Sep 07 13:06:33.607247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 21/37] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:06:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:34.472148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:34.472148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:34.508892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:34.511564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:34.512819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:34.513980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:34.520959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:34.521927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:34.824658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:34.834206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-654208e8-97f3-4c52-ad22-3824f0645685 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 1.395823 Sep 07 13:06:34.834811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 17/38] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:33 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:35.449026 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:35.480091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b8a71fc-5904-41ef-a661-9ca15221480d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1274 microversion: 2.1 time: 1.021288 Sep 07 13:06:35.483028 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 22/39] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:34 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1274 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:35.857477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:35.858821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:35.871898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:35.878751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:35.880816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:35.892782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:35.893299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:35.899739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:36.332554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2771d4db-f026-4607-9fc4-5d4d14ad36c0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: .version_select at 0x7fdc422c2550>, body: {"keypair": {"name": "tempest-keypair-2061771832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+zhRo0yvkH1YFiuEMeEt9YiUDftIGBnSdq0stO6xGIi69GFWzKSab9XAN7sIA0I7jU2+E+GrUXAwHn+AMt6O7P8R+Cc2rRwCPtFGBNQatGzHa5r+WoN1gMSyFlbIiAgA=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:36.427674 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-2771d4db-f026-4607-9fc4-5d4d14ad36c0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:36.442702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-2771d4db-f026-4607-9fc4-5d4d14ad36c0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for user 5235207aa3b5477eb76215ebb4a43c98 and project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:36.568102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2771d4db-f026-4607-9fc4-5d4d14ad36c0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.712987 Sep 07 13:06:36.568833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 18/40] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Sep 7 13:06:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1714 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:06:36.591549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:36.597341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:36.618591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:36.619463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:36.620368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:36.621464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:36.625853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:36.627423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:37.141897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:37.159168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-196b2e2d-1224-4dba-aa6d-c3c2b22e5f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1280 microversion: 2.1 time: 0.582994 Sep 07 13:06:37.161001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 19/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:36 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:37.823528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:37.838272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-65633ca4-4a39-4ea4-95c2-38a422ee1577 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 1.984606 Sep 07 13:06:37.840338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 23/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:35 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:38.192980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:38.193777 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:38.196005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=4 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:38.227076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:38.239925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:38.240581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:38.242327 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:38.247950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:38.250347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:38.485076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:38.514535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3422601c-4c6b-4de5-a96e-296c1c945895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1280 microversion: 2.1 time: 0.324039 Sep 07 13:06:38.518202 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 20/43] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:38 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:38.875287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:38.876063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:38.897943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:38.904296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:38.908983 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:38.912637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:38.917373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:38.919211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:39.553880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:39.554497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:39.571208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:39.572949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:39.574711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:39.576799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:39.579622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:39.583074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:39.748007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:39.768151 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a9d7ca98-9522-4665-b691-5163996451ee tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.898117 Sep 07 13:06:39.782197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 24/44] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:38 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:40.803298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:40.804108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:40.813771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:40.819650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:40.822000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:40.838717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:40.841415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:40.843495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:41.864915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:41.878398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9a3d327d-62cb-4c7d-bb2c-3970b6703008 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 2.329716 Sep 07 13:06:41.880334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 21/45] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:39 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:42.097621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a43fa6-feee-46eb-8439-0ab5e631ab83", "tag": "689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:42.140682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:42.144396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:42.149556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:42.210719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Creating event network-changed:689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f for instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 on hv-cinder-85331 Sep 07 13:06:42.212483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120817) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:06:42.214338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3f8ddc9f-d11d-447c-95c1-38d3929f17dc req-94cefe3c-8890-4498-a54c-14d25c8449fa service nova] Acquired lock "compute-rpcapi-router" {{(pid=120817) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:06:42.219304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:42.223968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:42.224970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:42.226145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:42.226886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:42.230042 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:42.246081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.compute.rpcapi [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:06:42.252893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] Releasing lock "compute-rpcapi-router" {{(pid=120817) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:06:42.298351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-90ba4a34-b3b3-4acd-9fe4-21e78016f04e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415414 Sep 07 13:06:42.299839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 22/46] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:42.923437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:42.925601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:42.950336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:42.952260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:42.954623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:42.956979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:42.959724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:42.962361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:43.458018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:43.564367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:43.579334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8102f3b9-3adb-4168-80d3-3c3758015ace tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 2.778867 Sep 07 13:06:43.580462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 25/47] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:40 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:43.842153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6ea81b-c4bc-4032-a3d9-db69e5369416", "tag": "04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:43.855112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:43.892243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:43.899069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:43.900227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:43.953989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Creating event network-changed:04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6 for instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 on hv-cinder-85331 Sep 07 13:06:43.955070 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:06:43.955896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ddf069c8-b10f-4be9-af1f-b6faceb73d54 req-9651a8df-027a-4da7-9681-567fb8a923d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:06:43.957220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:43.958305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:43.959929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:43.962800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:43.963508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:43.964134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:43.997014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.compute.rpcapi [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:06:44.000497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:06:44.021275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ff0779a3-ec6c-46f9-8af0-96d53e0bd3f8 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438191 Sep 07 13:06:44.022920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 26/48] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:44.328650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:44.340206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-083e8632-12ec-42ab-aa3b-bc757e451e0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 1.427608 Sep 07 13:06:44.343127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 23/49] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:42 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:44.606969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:44.608104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:44.645015 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:44.655710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:44.656464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:44.662829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:44.674190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:44.681130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:44.904923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1115621987", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b6a96b-b474-4212-8454-464c32633cf7"}], "security_groups": [{"name": "tempest-securitygroup--2084583533"}], "key_name": "tempest-keypair-1941015723", "user_data": "}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:45.481523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:45.523288 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24190893-ef6c-46a4-8c1c-1d365f6a7cab tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.920580 Sep 07 13:06:45.525274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 27/50] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:44 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:45.537369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:45.549538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:45.573217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:45.577033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:45.577726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:45.579051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:45.579746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:45.580402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:45.706092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] validate_networks() for [('58b6a96b-b474-4212-8454-464c32633cf7', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:06:45.939911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:45.954009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9ffebaa7-b067-48d4-b7a3-19358dfba5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.422010 Sep 07 13:06:45.958356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 28/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:45 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:45.980281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d592ba-7265-4b01-a55a-505ba33bbf71", "tag": "d4733634-c8bc-4e15-a679-5d5589eb48af"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:46.014713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:46.015461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:46.024404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:46.058093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] Creating event network-changed:d4733634-c8bc-4e15-a679-5d5589eb48af for instance a7d592ba-7265-4b01-a55a-505ba33bbf71 on hv-cinder-85331 Sep 07 13:06:46.074295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-8f477cf1-76f5-4758-87f6-b2e1cf68c6e5 req-66fb79d3-8061-4def-ad9a-c340101f283c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113333 Sep 07 13:06:46.077520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 29/52] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:46.287973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1906437745", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96da8e0f-45fb-42a6-934a-e34883330b52"}], "security_groups": [{"name": "tempest-securitygroup--1707553134"}], "key_name": "tempest-keypair-2061771832", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:46.369262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:46.458373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] validate_networks() for [('96da8e0f-45fb-42a6-934a-e34883330b52', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:06:46.481136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=20 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:46.680493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:06:46.681160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:06:46.681837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:06:46.682476 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:06:46.683023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:06:46.695101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:46.696091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:46.696806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:46.697831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:46.698483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:46.699066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:46.707349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=57 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:46.721708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:46.727094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:46.741794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:06:46.744606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:06:46.794703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-90340c09-a9ad-4e9b-878f-d010d9deab49 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.895464 Sep 07 13:06:46.795528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 24/53] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:06:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:06:46.802260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:46.802972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:46.810088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:46.810677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:46.811180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:46.811885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:46.812338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:46.812820 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:46.971922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:46.985620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6553af1b-fbfc-4c30-a7f9-1a5258662d77 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.188700 Sep 07 13:06:46.986736 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 25/54] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:46 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:46.994374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-66b198a6-3f32-4d4e-ad38-47e5182f5020 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:46.995292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-66b198a6-3f32-4d4e-ad38-47e5182f5020 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:47.080158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-66b198a6-3f32-4d4e-ad38-47e5182f5020 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:47.098295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-66b198a6-3f32-4d4e-ad38-47e5182f5020 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1242 microversion: 2.1 time: 0.108254 Sep 07 13:06:47.099145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 26/55] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:46 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:47.104445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:47.105065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:47.121620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:47.122853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:47.123811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:47.124792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:47.126065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:47.126500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:47.325076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:06:47.325500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:06:47.326217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:06:47.326618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:06:47.327021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:06:47.337728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:47.338192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:47.338628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:47.339482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:47.340015 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:47.340434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:47.358724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:06:47.363977 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for user 5235207aa3b5477eb76215ebb4a43c98 and project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:06:47.366129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:47.378530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:06:47.382112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:06:47.382825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ee9c6b6d-955c-40e0-82a0-d5f1fb6e1a25 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.282166 Sep 07 13:06:47.392911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 27/56] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:47 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:47.465313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c0ffd6cf-a11f-4e92-a0c2-f64e069e5a20 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.183892 Sep 07 13:06:47.472063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 30/57] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Sep 7 13:06:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 07 13:06:47.485694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:47.486988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:47.587326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:47.608119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:47.614003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:47.615907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0d3eab5e-2bde-427e-b19b-9da9ab819baf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1282 microversion: 2.20 time: 0.139610 Sep 07 13:06:47.634246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 28/58] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:47 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:48.009108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:48.009739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:48.016392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.016874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.017312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.018048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.018828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.019204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.122658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:48.123279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:48.130053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.130540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.130956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.131667 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.132122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.132548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.156189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.165149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cc938073-9865-4eb2-a970-7dea3ef3c47a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.159918 Sep 07 13:06:48.166113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 31/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:48 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:48.203672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.213411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8f41393d-8771-4c35-8c77-67f002810bf4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.094476 Sep 07 13:06:48.214107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 29/60] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:48 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:48.409809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:48.410418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:48.416264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.416788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.417163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.417883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.418345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.418760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.560258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.568619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1738e94b-715e-4402-8c38-c6d141488bc1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.163226 Sep 07 13:06:48.569457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 32/61] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:48 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:48.641926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:48.642733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:48.649184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.649729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.650215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.650912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:48.651357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:48.651768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:48.715319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.723993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.725440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:48.726577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-06e179ad-9cc0-4432-9862-2b983591e553 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.089602 Sep 07 13:06:48.727141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 30/62] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:48 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:49.188703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:49.189264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:49.196265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.196760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.197175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.197932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.198344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.198757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.240718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:49.241448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:49.249121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.249903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.250489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.251345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.252122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.252605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.345901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.356030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d3fabd48-56e6-4649-9422-150bd0a34631 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.121411 Sep 07 13:06:49.357015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 31/63] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:49 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:49.382897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.400823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:49.403330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e7d57b7e-8817-44cf-9dd7-69605bfb5a51 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.218719 Sep 07 13:06:49.403930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 33/64] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:49 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:49.592505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:49.593115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:49.600547 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.601034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.601473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.602193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.602649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.603069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.751272 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.754249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:49.754930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:49.762184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1dc00c66-ccc4-49e8-ba6f-54633b834588 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.173415 Sep 07 13:06:49.763012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 32/65] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:49 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:49.763317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.763882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.764325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.765045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:49.765491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:49.766240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:49.831052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.842047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.843677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:49.845210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-399d9ff6-3d4b-4811-8527-f9ca9fa87015 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.096436 Sep 07 13:06:49.846137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:49 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:50.398321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:50.399082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:50.407775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.408207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.408829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.429753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.429753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.429753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.429991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:50.429991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:50.439097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.441883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.442413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.444122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.444707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.447413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.494259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.503414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c933273c-5725-4a58-a30e-b492800edd48 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.108904 Sep 07 13:06:50.519404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 33/67] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:50 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:50.644320 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.655687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d87125a-7d63-41e0-a8b6-238745912aad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.232481 Sep 07 13:06:50.656810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 35/68] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:50 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:50.786695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:50.787210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:50.793278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.793795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.794233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.794920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.795370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.795791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.871243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:50.872047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:50.879042 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.879792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.880347 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.881154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:50.881703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:50.882194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:50.953981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.961152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.963202 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.964856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:50.966707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8583ba95-7c56-4ec4-b7fc-dcda5e8aaea2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.100798 Sep 07 13:06:50.967472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 36/69] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:50 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:50.969754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9107e9a4-a1b3-4dce-a413-684d5a0d8bad tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.187400 Sep 07 13:06:50.970325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 34/70] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:50 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:51.531409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:51.532341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:51.539659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:51.540145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:51.540581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:51.541266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:51.541724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:51.542179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:51.603215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:51.611228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a35d81e5-997c-4a87-913f-1f58833532f5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.085691 Sep 07 13:06:51.611743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 37/71] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:51 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:51.689074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:51.689728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:51.696756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:51.697251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:51.697690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:51.698630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:51.699082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:51.699504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:51.836533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:51.848486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-03886f09-4b7a-45c9-bafa-449326716073 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.163079 Sep 07 13:06:51.849310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 35/72] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:51 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:51.993886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:51.994452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:51.995226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:51.995913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:52.000657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.001413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.001848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.002492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.002706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.003177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.003712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.003849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.004244 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.004817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.005445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.006109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.078380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:52.087574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:52.089425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:52.091040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f9f12ccc-1941-41ea-b422-9a6845ff7aa0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.099909 Sep 07 13:06:52.091702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 36/73] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:52.145583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:52.153305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-304939b2-cdb8-47e1-ac08-802fa31dfa74 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.163524 Sep 07 13:06:52.153952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 38/74] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:51 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:52.634053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:52.634685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:52.641341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.641864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.642302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.642999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.643550 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.643990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.711826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:52.719951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-72134d4e-436a-4dfd-a986-82e6fdb47b9f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.089866 Sep 07 13:06:52.720525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 37/75] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:52 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:52.875570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:52.876110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:52.882797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.883355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.883778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:52.884461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:52.884906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:52.885322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.023394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.031522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eb5b20cb-360f-4655-ae55-2db3ce7f0f18 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.159909 Sep 07 13:06:53.032095 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 39/76] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:52 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:53.117776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:53.118403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:53.125212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.125773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.126150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.126837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.127284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.130341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.176079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:53.176782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:53.182962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.183446 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.183884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.184566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.185004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.185420 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.196056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.204439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.206388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.207160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-24ad5bb8-0228-4127-ac9b-a8c7af10a04e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.093472 Sep 07 13:06:53.207708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 38/77] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:53 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:06:53.323368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.333875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-500476af-367b-4697-b02f-91c816fcd34a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.161753 Sep 07 13:06:53.334447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 40/78] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:53 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:53.743107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:53.743994 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:53.750440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.750860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.751305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.751976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:53.752427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:53.753010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:53.814388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:53.822326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ae219b45-3b9e-4198-abc9-1a3a83cf8b52 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.083136 Sep 07 13:06:53.822864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:53 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:54.063421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:54.064244 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:54.071556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.072048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.072478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.073167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.073589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.074041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.211130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.218960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-342621dc-82f5-4894-a155-9a7907e517af tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.162185 Sep 07 13:06:54.219725 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 41/80] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:54 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:54.232578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:54.233185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:54.240083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.240549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.240979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.241692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.242168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.242581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.313137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.323612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.324985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.326159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e8cf8b35-3fe3-4ae4-bd00-a8abc7f8c31b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.097524 Sep 07 13:06:54.326712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 40/81] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:54 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:54.357632 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:54.358301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:54.365740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.366393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.367017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.368006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.368614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.369141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.510845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.523029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e406d054-5cf0-4058-bad7-e662f75b4895 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.169405 Sep 07 13:06:54.523859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:54 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:54.854961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:54.855551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:54.862812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.863332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.863772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.864463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:54.864917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:54.865334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:54.936408 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:54.947987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c6c7833b-f537-4cc0-b3f5-fef811d6916e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1246 microversion: 2.1 time: 0.096693 Sep 07 13:06:54.948792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:54 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:55.244791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:55.245626 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:55.256105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.256795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.257447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.258521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.259126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.259678 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.353399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:55.354099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:55.360443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.360931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.361365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.362082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.363266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.363690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.414395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:55.422615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24bfe31f-ff96-4619-8da6-d0133a2965fc tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.183630 Sep 07 13:06:55.423260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 43/84] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:55 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:55.429962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:55.438539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:55.439966 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:55.441134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-89d95ab3-240a-403c-bd15-1f0689999044 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1286 microversion: 2.20 time: 0.091912 Sep 07 13:06:55.441658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 42/85] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:55 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:06:55.550692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:55.551325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:55.560195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.560738 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.561173 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.561905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:55.562432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:55.562835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:55.700266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:55.709404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b00f3e2f-4d47-4c14-8ab5-1bb6c3163f87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.162931 Sep 07 13:06:55.710140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:55 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:55.978979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:55.983105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:56.008739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.012900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.013942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.020109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.021269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.023933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.060462 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:56.203709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.215441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-89f1cfcc-0d57-428c-a96d-793e447cab44 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1238 microversion: 2.1 time: 0.244958 Sep 07 13:06:56.216026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 43/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:55 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1238 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:56.447426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:56.448050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:56.454464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.454880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.455313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.456093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.456735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.457159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.466148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:56.466745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:56.472822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.473303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.473795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.474491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.474934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.475346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.543957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.553073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.554919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.556047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4d151eb1-cb7d-4c0b-84aa-092af9e28e34 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.093839 Sep 07 13:06:56.556882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 44/88] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:56 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:56.598644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.606923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-494690a0-ac5e-41f5-a94a-857b9d03055d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.163376 Sep 07 13:06:56.607577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 45/89] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:56 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:56.735012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:56.735628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:56.737757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=4 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:56.743391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.744104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.744549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.745279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:56.746011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:56.746511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:56.904687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:56.913080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dcb8d49e-431a-477a-9f03-62b504e9f1c0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.182956 Sep 07 13:06:56.913654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 45/90] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:56 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:57.253721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:57.254651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:57.260834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.261314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.261768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.262452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.262968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.263324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.328949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:57.337986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3e0488fe-9549-4d15-a0c7-061aee9b88c6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1294 microversion: 2.1 time: 0.088974 Sep 07 13:06:57.338665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 46/91] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:57 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:57.581406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:57.582032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:57.588186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.588663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.589090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.589798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.590246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.590656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.605575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=10 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:57.631274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:57.631956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:57.633921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:57.634783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:57.641224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.641849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.642378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.643129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.643734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.644340 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.655834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:57.669838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:57.672629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:57.674956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-09bc6f55-811d-4676-a1bf-760f1db2785e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.096810 Sep 07 13:06:57.675786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 46/92] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:57 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:57.798305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:57.807445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-43d8d791-8526-4251-b0ce-79d4a42c78a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.180160 Sep 07 13:06:57.808047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 47/93] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:57 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:06:57.936633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:57.937245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:57.944489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.944982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.945413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:57.946182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:57.946694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:57.947136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.104335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:58.113599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9cfdf3a3-c79e-4cf2-86d4-73284c5eae36 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.180912 Sep 07 13:06:58.114433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 47/94] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:57 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:58.362243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:58.362861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:58.369020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.369509 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.369980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.370673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.371126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.371547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.434048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:58.442635 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fcd6706f-7470-41bc-94a9-0c84a8e38d63 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1294 microversion: 2.1 time: 0.084361 Sep 07 13:06:58.443219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 48/95] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:58 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:58.704216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:58.704825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:58.711907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.712411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.712825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.713511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.713971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.714414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.783023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:58.792395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:58.793893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:58.795039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-692cfd31-ad14-4847-b37d-ec34628bbcf3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.094779 Sep 07 13:06:58.795621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 48/96] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:58 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:06:58.832680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:58.833268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:58.839552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.839910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.840326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.841016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:58.841459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:58.841906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:58.997862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.005888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3a9c0627-ff6a-4637-8d2b-921730d22790 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.177359 Sep 07 13:06:59.006471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 49/97] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:58 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:59.145574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:59.146246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:59.153695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.154383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.154579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.155293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.155794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.156260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.291495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.299509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-37b1f5a3-db1e-43f1-b2c8-d7b3ef1e532a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.158610 Sep 07 13:06:59.300218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 49/98] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:59 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:59.467492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:59.468289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:59.478097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.479214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.480085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.481076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.481709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.482594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.505180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:59.557438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.565760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-12f30306-bd17-4ba0-92f2-41f207c03bfb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1294 microversion: 2.1 time: 0.103553 Sep 07 13:06:59.582614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 50/99] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:06:59 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:06:59.831788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:59.832433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:59.841963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.842578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.843289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.844051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:59.844727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:59.845350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:59.944048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.958089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.960103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:06:59.961480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4847cac6-0ffd-467c-8ccb-26822186ea77 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.134082 Sep 07 13:06:59.962850 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 50/100] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:06:59 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:00.029561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:00.031744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:00.039832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.040515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.041331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.042564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.043556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.044179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.222980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:00.234413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-91b3e0c6-b060-403a-aeb4-1b33617264eb tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.207701 Sep 07 13:07:00.236228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 51/101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:00 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:00.322839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:00.323438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:00.329825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.330314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.331128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.332253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.332958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.333599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.597424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:00.598324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:00.610827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.611594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.612286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.614084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.615478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.616569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.676011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:00.689211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-363a5af5-6a38-4cb0-ba3b-8540f0c767f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.370127 Sep 07 13:07:00.694444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 51/102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:00 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:00.738778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:00.755882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-447d07ce-a652-4cc2-97d5-1e8eed0c65f4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1294 microversion: 2.1 time: 0.162810 Sep 07 13:07:00.756803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 52/103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:00 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:00.990091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:00.990859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:00.997623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:00.998452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:00.999051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:00.999833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.000381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.000864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.081220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.093356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.096137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.098360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d6fa9a32-b729-44a6-9aac-679651a0ba5d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.114067 Sep 07 13:07:01.100483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 52/104] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:00 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:01.261655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:01.263058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:01.271075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.272122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.272720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.273610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.274107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.274674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.510701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.523163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8d7f3d97-2f01-4f4c-83c1-6533b54b84ca tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.267559 Sep 07 13:07:01.537410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 53/105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:01 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:01.717745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:01.718553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:01.725081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.728357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.729454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.730942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.731925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.733626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.781016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:01.781974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:01.789403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.790727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.795336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.796299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:01.796984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:01.798080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:01.879979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.893867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-89e5d92b-8c25-4532-9ea3-22db107b50eb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1294 microversion: 2.1 time: 0.117377 Sep 07 13:07:01.895010 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 54/106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:01 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:01.920625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:01.930936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d9241a1b-2dfc-4189-9c3c-6aec222924fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.217683 Sep 07 13:07:01.943427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 53/107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:01 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:02.125391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:02.126098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:02.138930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.139485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.142795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.145433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.147740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.149550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.360813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:02.380918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:02.389218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:02.391972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca5c01c0-88c6-4a55-bff7-cdb122de93a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1278 microversion: 2.20 time: 0.271759 Sep 07 13:07:02.400996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 55/108] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:02 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:02.551890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:02.552809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:02.566610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.567132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.567578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.568303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.568760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.570586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.917715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:02.918656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:02.937264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.937792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.938232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.938968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.945849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.947814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.195606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.203867 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5a28714b-b0d9-438a-a068-5ffa5704ddba tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.658466 Sep 07 13:07:03.204728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.206586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 54/109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:02 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:03.212934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1e8ab3e3-a62d-4a22-a185-7bffbdcf47e9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1302 microversion: 2.1 time: 0.300074 Sep 07 13:07:03.228505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 56/110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:02 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1302 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:03.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:03.234266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:03.258470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.261521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.262191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.263091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.265415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.266091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.452028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.460735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6cf3a998-c360-4389-8a71-ca1eddcd9a4b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.231226 Sep 07 13:07:03.461281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 55/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:03 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:03.467162 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:03.468136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:03.475963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.476763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.477347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.478254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.478714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.479132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.543195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a43fa6-feee-46eb-8439-0ab5e631ab83", "name": "network-vif-plugged", "status": "completed", "tag": "689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:03.553970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.554546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.554923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.555397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.567499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.568917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] Creating event network-vif-plugged:689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f for instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 on hv-cinder-85331 Sep 07 13:07:03.569087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:03.571418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d4b0ed14-9c16-493b-9ae7-747050a7eec1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.109229 Sep 07 13:07:03.572125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 56/112] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:03 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:03.578544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-b013b52a-d64b-4b67-aca8-52d8b9f4df5f req-99b2bda1-d9a4-46b2-bd9e-c67681eadaaf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166147 Sep 07 13:07:03.579323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 57/113] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:04.237320 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:04.239099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:04.240326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:04.241376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:04.256489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.256985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.257423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.258153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.258604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.260216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.260705 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.261307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.262283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.262734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.263145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.264014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.378797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.393199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-533c453a-a1d9-4038-ad6f-bef7ab4a5304 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1300 microversion: 2.1 time: 0.160681 Sep 07 13:07:04.395760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 58/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:04 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:04.491236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:04.492336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:04.509204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.509753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.510194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.510916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.511373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.511799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.512217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.522668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-20644ab0-1287-4495-86e6-5cf0141ca2c6 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.297683 Sep 07 13:07:04.535214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 57/115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:04 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:04.600278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:04.601827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:04.615806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.616312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.616913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.618852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.619497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.620072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.736274 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.750974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.754866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.756016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-118c75e9-049b-40ef-ae8d-afed59df536c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.162102 Sep 07 13:07:04.756565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 58/116] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:04 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:04.800902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:04.823303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2aad7588-6c27-49e5-88b2-7a45d65230e1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.337318 Sep 07 13:07:04.824016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:04 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:05.420145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:05.420941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:05.453933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.462100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.462830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.468064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.468573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.469085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.551220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:05.552413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:05.570932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.571953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.573286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.575451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.576602 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.577628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.715074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:05.723866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1f22d83a-e6c6-4a26-b41a-2c040671508a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1300 microversion: 2.1 time: 0.308714 Sep 07 13:07:05.729398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 59/118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:05 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1300 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:05.785170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:05.786249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:05.792923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.794137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.794798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.796087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.796692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.797307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.803394 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:05.894074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:05.905581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:05.908335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:05.909997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-741feb6c-c2f5-4b99-9cdc-5a60e7a0a151 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.130107 Sep 07 13:07:05.910886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 60/119] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:05 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:05.915986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:05.917037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:05.919375 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:05.927869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.928690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.928917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2595fe6b-a016-4f20-9cf2-3a0a56f7c1a0 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.384837 Sep 07 13:07:05.929440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.938363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 60/120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:05 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:05.940377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:05.942604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:05.943348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.108129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:06.118742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3b5a9b0d-c1ac-4d69-883a-abbe36ccc935 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.206375 Sep 07 13:07:06.130230 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 61/121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:05 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:06.756233 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:06.756821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:06.766972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.771210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.772262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.773866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.776915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.777357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.883020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:06.894836 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9c36ff68-8561-4acb-8064-263c894fd2fa tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1300 microversion: 2.1 time: 0.141490 Sep 07 13:07:06.897888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:06 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:06.946906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:06.948278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:06.951714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:06.952315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:06.955134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.955802 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.957399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.958451 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.959057 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.959625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.962388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.962929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.963432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.964222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.965058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.965058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.053721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:07.064633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:07.067737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:07.069656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ddc50e5f-335c-4750-8222-8d5c8e145e2c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.126783 Sep 07 13:07:07.070506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 62/123] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:06 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:07.151266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:07.152207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:07.166765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.167340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.167800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.171501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.173559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.174235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.215461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:07.244302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1972312d-5209-4f3a-baa2-21fa083681be tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.296163 Sep 07 13:07:07.249328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 62/124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:06 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:07.419188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:07.428859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e6a15e0e-2523-42af-aadf-586c4718fb59 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.282856 Sep 07 13:07:07.429750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 63/125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:07 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:07.926402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:07.926402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:07.928268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.928892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.929592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.930058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.930512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.931214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.015364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.026225 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24c5077d-2224-410d-81f7-103a812e1501 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1300 microversion: 2.1 time: 0.110141 Sep 07 13:07:08.027709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 63/126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:07 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:08.097522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:08.098301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:08.105939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.106523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.107174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.108062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.108515 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.109112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.174728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.184412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.185889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.187001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-11617232-2305-4768-90a5-a4bfb51e43cb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.094355 Sep 07 13:07:08.189806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 64/127] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:08 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:08.273378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:08.274449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:08.281360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.281888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.282515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.283388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.284312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.285107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.428974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.443968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b39fb68-58c4-4359-8c9c-4bec04f4cd08 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.174672 Sep 07 13:07:08.444723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 64/128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:08 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:08.458964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:08.459725 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:08.463115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:08.467218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.467980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.468735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.469443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.469996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.470781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:08.633654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bc22e0e8-8565-413e-b617-64ff2a96106e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.181599 Sep 07 13:07:08.634357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 65/129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:08 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:09.051717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:09.052328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:09.062489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.064203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.066856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.067718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.070772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.071522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.214917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:09.215600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:09.222340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.223197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.223878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.224673 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.225382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.226002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.393001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:09.403899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ed087ef-40d9-46ad-b3ce-f969795dcace tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1300 microversion: 2.1 time: 0.357730 Sep 07 13:07:09.405424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 65/130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:09 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1300 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:09.469554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:09.470864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:09.480653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.482190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.483149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.484114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.484711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.485268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.615821 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:09.631598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:09.635920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:09.637380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-da33d8b8-d2bd-451a-b6d5-509f8c9c3962 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.427572 Sep 07 13:07:09.639807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 66/131] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:09 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:09.660060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:09.660674 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:09.681967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.686041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.688411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.692092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.697314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.698249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.839242 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:09.865768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b312b311-c74e-4d97-accb-4f96d94be108 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.399390 Sep 07 13:07:09.866679 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 66/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:09 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:10.037409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:10.048075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-15ea3fe6-a6ea-4c99-9294-4e0b365fc970 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.392657 Sep 07 13:07:10.048657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 67/133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:09 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:10.431948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:10.432568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:10.439415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.439921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.440464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.441347 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.441965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.443675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.625443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:10.629754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:10.638958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3edd270-1f89-4362-b3b0-a71f2b354792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.214006 Sep 07 13:07:10.639791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:10 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:10.668504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:10.669861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:10.676338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.677109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.677541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.678273 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.678740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.679128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.747844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:10.758614 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:10.760288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:10.761764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-beb98bb4-6eb0-45ec-9bdf-01030009eddc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.097193 Sep 07 13:07:10.762600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 68/135] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:10 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:10.889467 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:10.890331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:10.894906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:10.899498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.900345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.901190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.902119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.903384 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.904130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.070296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.071227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:11.072009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:11.079628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e4fecf2a-71c4-40cd-ade4-d9651c702f9d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.194468 Sep 07 13:07:11.079993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.080479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.080930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.081562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:10 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:11.094374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.094909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.095626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.451991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.461168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-66f53b12-6316-4874-8434-df0a831425f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.393605 Sep 07 13:07:11.461854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:11 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:11.663464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:11.664046 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:11.670263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.670831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.671340 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.672092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.672899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.673313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.788908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:11.789882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:11.797204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.797711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.798146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.798890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:11.799335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:11.800544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.825174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.832951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ee8d3c05-ed28-4588-9eef-9a4ea1d293f3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.173487 Sep 07 13:07:11.833764 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:11 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:11.870587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.880486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.882085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:11.883262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b62167b7-d620-4c5a-874f-ffc30ea52e07 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.100075 Sep 07 13:07:11.883852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 70/139] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:11 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:12.106467 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:12.107543 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:12.113520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.114020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.114629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.115296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.115765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.116326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.254424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:12.262406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f1258ce8-5072-4935-aea1-294ad91620bd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.159720 Sep 07 13:07:12.262986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 70/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:12 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:12.485012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:12.485622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:12.492503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.492986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.493418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.494144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.494585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.494995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.632106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:12.639884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7e712bf1-c34a-4c1e-b3f2-bdd495c0572a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.158917 Sep 07 13:07:12.640454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:12 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:12.856773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:12.857317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:12.864033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.864525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.864955 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.865644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.866117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.866531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.909281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:12.911432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:12.918398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.918913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.919262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.920073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.920634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.921146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.994081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.005531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.007655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.008787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-47ab6dec-03b6-41af-ba9f-b0f60f86cf3c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1334 microversion: 2.20 time: 0.104172 Sep 07 13:07:13.009374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 72/142] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:12 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:13.018007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.028253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-99d0e24b-4a92-4467-aea6-35114cb167a2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.175266 Sep 07 13:07:13.028954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:12 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:13.285998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:13.286636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:13.293254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.293988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.294561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.295392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.296017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.296572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.663077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:13.663969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:13.671189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.672048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.674529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.676299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.677020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.678510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.704264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.712968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8436d42a-6f43-4db4-bdd7-24e3cba7796e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.430840 Sep 07 13:07:13.726482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 73/144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:13 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:13.851025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:13.868193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f1dc9408-863b-4551-a495-dae9c45dc57b tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.209045 Sep 07 13:07:13.869090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 72/145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:13 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:14.035861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:14.036477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:14.050483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.051315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.051898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.052764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.053476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:14.053621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.054045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.054682 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:14.062007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.062742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.063427 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.064474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.065162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.065976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.185166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:14.193998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:14.201516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:14.202908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-77f72ddf-8f0d-4ffe-a26b-1e703343add8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1340 microversion: 2.20 time: 0.171442 Sep 07 13:07:14.214490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 74/146] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:14 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:14.255928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6ea81b-c4bc-4032-a3d9-db69e5369416", "name": "network-vif-plugged", "status": "completed", "tag": "04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:14.286525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.288911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.290852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.329964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] Creating event network-vif-plugged:04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6 for instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 on hv-cinder-85331 Sep 07 13:07:14.347528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-6de92d44-559e-4704-90d0-4c14255e7a03 req-3f03bffe-75b6-4c96-bd41-ebdd4e0c3bd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095930 Sep 07 13:07:14.349581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:14.349762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 75/147] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:14.358215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-732db0ed-8a03-4945-9edd-b91ecb622d75 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.309290 Sep 07 13:07:14.361647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:14 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:14.612053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220b5e26-01bc-4cee-83b3-abe0a93330b4", "tag": "63ed0758-4564-4a5f-b057-7bdbda974012"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:14.628461 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.630034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.630555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.659027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] Creating event network-changed:63ed0758-4564-4a5f-b057-7bdbda974012 for instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 on hv-cinder-85331 Sep 07 13:07:14.673179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-82724031-87ba-4c65-b47d-b2e590ab2664 req-4f476b7b-0770-4885-91f9-d09f0e2d49e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065320 Sep 07 13:07:14.674005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 76/149] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:14.752486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:14.754450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:14.761314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.762208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.762933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.764851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.765840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.766468 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.902743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:14.903908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:14.914367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.915089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.916111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.918396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.919171 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.919922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.041484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.049933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f55a244d-6e4f-4220-8a96-d75fab4cc85f tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.301633 Sep 07 13:07:15.053718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 74/150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:14 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:15.197716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.207392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e2d0bdc8-cc70-4007-bc21-1d799a007037 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.319022 Sep 07 13:07:15.208166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 77/151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:14 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:15.232879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:15.233483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:15.239874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.240531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.241119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.241858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.242442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.243169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.385497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:15.386146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:15.396510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.397399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.398191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.399063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.399705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.400287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.405123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:15.405285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.426782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.429659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.431804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ced43be-a6f8-47ba-a168-144e22f35cf8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.202971 Sep 07 13:07:15.433434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 75/152] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:15 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:15.564717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:15.572998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8bfcf269-68d2-41b4-8a6f-81224e297e6a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.191959 Sep 07 13:07:15.574247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 78/153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:15 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:16.073163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:16.074483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:16.089306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.090076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.093651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.095234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.096483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.098507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.231775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:16.233094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:16.242890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.243549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.244554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.245572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.246409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.247170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.349190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.360191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-98d9728b-5f8f-4e17-acf3-29023b3d0b76 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.290987 Sep 07 13:07:16.361374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 76/154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:16 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:16.386702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d592ba-7265-4b01-a55a-505ba33bbf71", "name": "network-vif-plugged", "status": "completed", "tag": "d4733634-c8bc-4e15-a679-5d5589eb48af"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:16.430164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.431085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.432722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.467989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] Creating event network-vif-plugged:d4733634-c8bc-4e15-a679-5d5589eb48af for instance a7d592ba-7265-4b01-a55a-505ba33bbf71 on hv-cinder-85331 Sep 07 13:07:16.476174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-44470ad3-4c4e-4a5a-8275-2052bfc823d4 req-509e7b8e-b63a-41ad-ac70-d09728cf0b2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093923 Sep 07 13:07:16.478073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 77/155] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:16.484833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:16.486455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:16.498657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.499360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.500531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.501561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.502263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.502790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.734152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.744360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b6e5db93-eb00-4fa0-bf4d-ded8d8dc89c2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.516693 Sep 07 13:07:16.744941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:16 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:16.750067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:16.750665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:16.757129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.757826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.764883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.765992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:16.767579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:16.768277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.837488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.854887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.857012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.858434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0fd19d6a-7324-4972-ab13-fca13aae1f43 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.378544 Sep 07 13:07:16.859248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 78/157] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:16 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:16.925969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:16.941106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2d521fcf-8bf5-491c-ae45-77f63363b484 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.195028 Sep 07 13:07:16.941831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 80/158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:16 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:16.998521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:17.009174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.009563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.010098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.022146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] Creating event network-changed:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:07:17.027064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-8a26e7dd-3f51-4533-a8f8-9e5e6bfd5271 req-95ee8ea5-0cbb-467d-9600-9aa3bcfe41fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Sep 07 13:07:17.027662 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 79/159] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:17.389585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.389585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.396841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.397928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.398574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.399809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.400494 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.401100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.548681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:17.556956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2befe1cc-90c2-486b-ae87-8af42e6efb3c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.175092 Sep 07 13:07:17.566528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 81/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:17 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:17.772585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.773277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.779692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.780177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.780672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.781397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.781875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.782287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.896998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.898667 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.907669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.908329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.908778 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.910619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.911123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.911596 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.933075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:17.942027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c13357e0-5fd9-4aff-9d44-ffd2104f1ebc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.174090 Sep 07 13:07:17.942805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 80/161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:17 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:17.964362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.964975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.971285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.971840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.972252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.972939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.973381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.973791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.067733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.076968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.078537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.079797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c5cbdd57-ef09-4cb7-b7df-f5f45193f557 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.198036 Sep 07 13:07:18.081712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 82/162] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:17 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:18.124102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.133016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e47e5284-0e0e-492f-8e48-5b90bd09e571 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.172663 Sep 07 13:07:18.133615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 81/163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:17 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:18.580124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:18.580731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:18.587031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.587511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.587936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.588650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.589135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.589560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.734475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.743622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0cbbaa81-a1f1-414a-8da0-6c7ccbf2cd64 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.167297 Sep 07 13:07:18.744569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 83/164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:18 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:18.966144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:18.966763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:18.973447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.973880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.974312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.975024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.975473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.975909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.105718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:19.106399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:19.113920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.114386 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.114824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.115543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.116051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.116450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.128122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.136901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ee079c99-7c30-451c-a5bd-d04c2871059a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.174733 Sep 07 13:07:19.137494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 82/165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:18 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:19.157092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:19.157875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:19.164864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.165360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.165827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.166520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.166969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.167378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.253348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.262053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.263486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.264782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8f3ada4b-4e5a-4b9b-828e-a4ff879ee73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.162999 Sep 07 13:07:19.265309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 84/166] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:19 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:19.306354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.316914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f4a7ce30-c74c-414f-868c-01988ab6a3b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.163641 Sep 07 13:07:19.317484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 83/167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:19 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:19.767672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:19.768261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:19.775469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.775963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.776402 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.777101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.777554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.778017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.925164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:19.933400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a7a1c18e-3849-40f9-8213-12efbeb30672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1315 microversion: 2.1 time: 0.169839 Sep 07 13:07:19.934029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 85/168] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:19 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:20.163918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:20.164512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:20.171073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.171570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.172026 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.172995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.174049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.174534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.291481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:20.292078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:20.298556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.299044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.299474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.300236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.300668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.301085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.327273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.335822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-01e677d6-61a3-42ce-86dc-fb80c069976f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.179064 Sep 07 13:07:20.336396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 84/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:20 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:20.349722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:20.350768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:20.357526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.358053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.358514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.359212 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.359659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.360079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.457683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.466846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.468461 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.469783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8a9d1b77-4bea-4eb5-ac21-5b350148e4f2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.182234 Sep 07 13:07:20.470340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 86/170] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:20 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:20.535566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.539441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:20.544589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c61f4806-7840-4287-9e02-dbc1c266acf5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.198739 Sep 07 13:07:20.545223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 85/171] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:20 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:20.958003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:20.958899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:20.967404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.968015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.968593 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.969568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:20.970063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:20.970491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.147740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.157823 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1533a5d6-eb62-48b0-8107-0674ae979a11 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1502 microversion: 2.1 time: 0.204665 Sep 07 13:07:21.158433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 87/172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:20 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:21.360237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:21.360973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:21.367671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.368160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.368591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.369292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.369765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.370181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.497239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:21.498030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:21.505991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.507957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.508739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.509626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.510298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.510752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.537174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.542328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e62e8f38-b30c-4f85-9f1d-397f60ff7bc4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.186229 Sep 07 13:07:21.543011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 86/173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:21 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:21.568942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:21.569699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:21.577884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.578372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.578802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.579611 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.580192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.580594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.656592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.665816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.667769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.668807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-adb45a63-b871-45e8-8efc-7dc0de9ba9fc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.177142 Sep 07 13:07:21.669382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 88/174] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:21 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:21.729452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:21.744819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a9f80a01-7404-4c78-b67d-c27663ff3f4e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.179887 Sep 07 13:07:21.745910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 87/175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:21 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:22.565625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:22.566906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:22.573949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.574680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.575108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.575794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.576431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.576836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.704219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:22.705486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:22.714064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.714804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.715447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.716308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.717079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.717542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.753185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.761583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-07163b06-d179-4190-9327-d2ec29ff40fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.199929 Sep 07 13:07:22.764276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 89/176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:22 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:22.770200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:22.770826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:22.777407 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.778126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.778568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.779343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:22.779801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:22.780344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.910246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.932411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.935676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.938822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-29f3f044-18ba-4b4c-ae78-b716a48bb5b3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.239856 Sep 07 13:07:22.951844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 88/177] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:22 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:22.972628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.995492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bc651f07-fe4e-4352-80c7-d51f1448e1ef tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.229655 Sep 07 13:07:22.998769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 90/178] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:22 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:23.788027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:23.788644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:23.795267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.795760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.796175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:23.796891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.797341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.797760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:23.944896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:23.953656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-591e63e3-0082-478a-8045-b2a0e3937522 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.169800 Sep 07 13:07:23.954265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 89/179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:23 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:23.977340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:23.978622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:23.985070 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.985571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.986016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:23.986905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.987388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.987838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.036259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:24.036259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:24.042996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:24.043632 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:24.044568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.045599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:24.046435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:24.047074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.174210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:24.200964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:24.202652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:24.204109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d2440673-51ba-4f13-a496-71e0b4b294de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.230470 Sep 07 13:07:24.214785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 91/180] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:23 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:24.285155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:24.301696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a8e253ae-f23a-483b-8ac2-2e010dc2478f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.272573 Sep 07 13:07:24.302865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 90/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:24 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:24.977000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:24.977644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:24.984133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:24.984597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:24.985052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.985851 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:24.986323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:24.986740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.122624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:25.131192 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4635863b-651f-4471-a6e8-ce6aeced7a82 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.157977 Sep 07 13:07:25.131780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 92/182] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:24 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:25.234990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:25.236178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:25.252872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.252872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.252872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.252872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.253283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.253283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.328716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:25.329836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:25.337589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.338810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.339995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.341062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.341859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.342665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.410835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:25.419487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:25.420911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:25.422047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b11bac2d-8d0a-4bbb-8934-7a7694912319 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.191979 Sep 07 13:07:25.422600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 91/183] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:25 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:25.487852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:25.495599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c1d33c9c-e066-4d90-a40c-45ec2fb91a4d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.172002 Sep 07 13:07:25.496208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 93/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:25 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:26.155443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:26.156092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:26.162573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.163053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.163492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.164185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.164629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.165041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.454224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:26.454224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:26.461432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.461432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.461432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.461432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.461991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.461991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.561128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.570447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fbdbb3f3-7ae3-431c-b064-2c867ac8b9b5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.418738 Sep 07 13:07:26.570908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 92/185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:26 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:26.575880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:26.576469 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:26.583379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.583862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.584489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.585171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.585803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.586420 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.613881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.616149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:26.623940 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.625371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.626510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-67d553b1-c71a-437a-ab3c-1969983f42d1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.182280 Sep 07 13:07:26.627059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 94/186] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:26 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:26.722777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.731746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b0562960-51b9-4d28-9e17-781cb5a16fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.159444 Sep 07 13:07:26.732342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 93/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:26 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:27.593583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:27.594209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:27.600946 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.601315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.601772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.602464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.602908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.603319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.652242 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:27.652949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:27.664515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.665478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.666396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.667713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.668589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.669189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.765246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:27.775204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-38c98be7-5bd6-41a4-beef-5f307548d358 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.185580 Sep 07 13:07:27.777860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 95/188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:27 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:27.780583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:27.781437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:27.788060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.788499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.788983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.789866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.790609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.790765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.823304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:27.832430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:27.834260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:27.835531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa61460e-5ee2-4d04-bb7d-f619128efbe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.187365 Sep 07 13:07:27.836554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 94/189] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:27 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:27.911058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b52b93a-2618-4db2-98c0-18c5c0617a3b"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:27.914933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:27.921538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.922056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.922491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.923540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.924100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.924523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.954031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:27.962284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-068b61a3-f075-4350-a0a2-59758ea16c36 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.185397 Sep 07 13:07:27.962975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 96/190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:27 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:28.707693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1712962681", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:28.766392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] validate_networks() for None {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:07:29.085761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:07:29.086137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:07:29.086600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:07:29.086983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:07:29.087378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:07:29.096206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.096685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.097221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.098068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.098517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.098933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.116002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Getting quotas for project 1f2e1474e0024ac3918f295c3e228869. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:07:29.120069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Getting quotas for user c589c9ed14594c498eb5a2af90030231 and project 1f2e1474e0024ac3918f295c3e228869. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:07:29.132438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:07:29.134785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:07:29.186588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-71dd983f-2d74-41e1-a627-9a2be7dd9885 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483364 Sep 07 13:07:29.187460 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 97/191] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:07:29.194351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:29.195061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:29.201343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.202469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.202922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.203627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.204212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.204653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.347432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.355416 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0cbf58ef-87a7-4d5d-8e4d-2acc17d3a2e8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1322 microversion: 2.1 time: 0.164880 Sep 07 13:07:29.370610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 98/192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:29 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:29.376995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:29.377708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:29.385312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.385879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.386388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.387247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.387708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.388176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.549733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.559524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.561121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.562396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-91715f52-6401-492b-ab00-6094581d9a7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.190674 Sep 07 13:07:29.562953 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 99/193] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:29 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:29.567587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:29.568188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:29.577167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.577663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.578570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.579125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.579401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.579830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.808892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.819479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-da4a9b45-cfb6-44c9-848a-7b20917c02e2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.255478 Sep 07 13:07:29.821056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 100/194] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:29 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:29.825951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:29.826650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:29.833329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.834139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.834966 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.835884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:29.836564 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:29.837199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:29.917082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:29.926561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b7350805-9c39-4a15-be86-3d1a0890d8b3 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1219 microversion: 2.1 time: 0.104188 Sep 07 13:07:29.927620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 101/195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:29 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:30.383276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:30.383898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:30.390163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.390661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.391091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.391776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.392499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.392941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.636167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-37e9474c-d66e-46be-bee4-6f96a0ded71b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "POST /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.729351 Sep 07 13:07:30.645478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 95/196] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:07:27 2022] POST /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83/os-volume_attachments => generated 194 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:30.654698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:30.657324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:30.667840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.668781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.670284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.671252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.671725 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.672533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.703396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:30.714384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-71777a2c-8dd2-46b9-b221-e80ab4529a6d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1516 microversion: 2.1 time: 0.335317 Sep 07 13:07:30.717139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 102/197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:30 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:30.744616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:30.747599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:30.772503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.773451 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.774139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.775330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.776445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.777197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.852600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'flavor' on Instance uuid a7d592ba-7265-4b01-a55a-505ba33bbf71 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:07:30.884353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:30.893962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:30.895446 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:30.896641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f869bc45-ca35-4081-8035-7f2eb00241ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.248148 Sep 07 13:07:30.897345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 96/198] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:30 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:30.902234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:30.902842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:30.909841 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.910755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.911342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.912105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:30.912550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:30.913009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:30.989435 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-654d601b-27cb-4737-b219-325752f1d1ee tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71/action" status: 200 len: 32 microversion: 2.1 time: 0.249710 Sep 07 13:07:30.990321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 103/199] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:07:30 2022] POST /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:07:30.996859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:30.997594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:31.010251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.011425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.012103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:31.012875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.013387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.013950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:31.074592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:31.084354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1728bc71-891f-476f-8c6b-440433392d72 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.185798 Sep 07 13:07:31.085276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 97/200] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:30 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:31.101187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:31.101981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:31.112793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.114642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.115363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:31.116357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.117068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.117767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:31.290535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:31.299149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cd8e7376-503b-4b68-a070-06ebfba2ff39 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.212520 Sep 07 13:07:31.300396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 98/201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:31 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:31.313256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:31.322986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-67ea9b31-c956-41ad-b9bc-10af9a4e1a77 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.331180 Sep 07 13:07:31.323571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 104/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:30 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:31.923859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:31.924481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:31.931672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.932169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.932622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:31.933332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:31.933819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:31.934241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.082396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.090939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.092495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.093693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-728d35de-ae21-498f-95e0-9669a67c6321 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.174002 Sep 07 13:07:32.094344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 99/203] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:31 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:32.111117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:32.112545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:32.119238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.119728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.120163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.120850 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.121299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.121738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.261401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.271061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fad25f4d-0cd0-4835-ad9d-b32e607ce18b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.164333 Sep 07 13:07:32.271725 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 105/204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:32 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:32.324402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:32.325014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:32.332549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.333019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.333596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.334342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.335031 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.335411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.346985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:32.347817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:32.355327 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.355877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.356645 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.357824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:32.358542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:32.359216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:32.437783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.448004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-71c0b851-9a82-48de-9a24-0edab6663f79 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.105408 Sep 07 13:07:32.448980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 106/205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:32 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:32.488578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:32.496492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fe0175c1-ec0e-45a5-b6cf-6ebe28aa13a5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.176957 Sep 07 13:07:32.497093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 100/206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:32 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:33.123221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:33.123776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:33.133319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.134143 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.134842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.135843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.136453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.137091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.273542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.281958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.283384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.284491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-362b1908-55e8-4f71-96b4-fad935c00c32 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.167485 Sep 07 13:07:33.285257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 107/207] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:33 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:33.294512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:33.295111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:33.304779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.305263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.305709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.306458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.306880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.307322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.311583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:33.441336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.450742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7c867da3-7cbc-4968-9515-0eb69ba4e275 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.159919 Sep 07 13:07:33.451430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 101/208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:33 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:33.470545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:33.471169 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:33.473196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:33.478411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.478897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.479323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.480006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.480452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.480864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.525452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:33.526486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:33.535861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.536344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.536769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.537472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:33.537960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:33.538372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:33.552173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.559953 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b4dbebc8-047c-4cc3-99e4-3570e1e4cf36 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.093469 Sep 07 13:07:33.560544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 108/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:33 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:33.672858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:33.681641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f41761f7-ed99-4488-beb6-08129a2ac9b1 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.164250 Sep 07 13:07:33.682289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 102/210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:33 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:34.311099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:34.311693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:34.318737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.319231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.319662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.320361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.320814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.321234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.475639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.478675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:34.479752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:34.486081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.487477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.489133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a614b282-d91e-4c24-b03b-51ccf6960e13 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.181939 Sep 07 13:07:34.489950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 109/211] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:34 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:34.491163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.491917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.492556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.493796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.494331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.495039 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.584503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:34.585117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:34.591960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.592584 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.593092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.594005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.594532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.595028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.601214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:34.640191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.648624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ddce0e07-2956-4b4e-9d1d-206c806aa7d7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.177058 Sep 07 13:07:34.649209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 103/212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:34 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:34.665182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.673663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1dd43475-efc9-42b7-9907-97fd2e00894f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.093514 Sep 07 13:07:34.674252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 110/213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:34 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:34.704496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:34.705125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:34.711971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.712458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.713078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.713574 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:34.714023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:34.714445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:34.858170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:34.867833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cfd5a188-01be-4150-9291-52020e403822 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.167136 Sep 07 13:07:34.868415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 104/214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:34 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:35.515326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:35.516039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:35.524026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.524523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.524956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.525650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.526146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.526565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.673903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:35.676530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:35.677192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:35.682964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:35.684429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:35.685536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b0e134af-3197-4e9a-a03d-5124704540c6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.174245 Sep 07 13:07:35.686215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 111/215] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:35 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:35.693816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.694306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.694765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.695546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.696000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.696463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.702513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:35.703764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:35.714881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.716170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.716899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.718051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.718874 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.719735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.792915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:35.801156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1d6e62d1-3b0b-4e1a-9691-d4f0d7681429 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.107196 Sep 07 13:07:35.801885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 112/216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:35 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:35.835150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:35.843464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-acca79bc-c1b8-414e-b9e0-e0c45a1b4739 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.174916 Sep 07 13:07:35.844049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 105/217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:35 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:35.891749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:35.892350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:35.899114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.899604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.900034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:35.900725 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:35.901171 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:35.901589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.044015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:36.052350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3a6ac679-10f3-4bd8-ae88-788965a2a837 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.164554 Sep 07 13:07:36.052920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 113/218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:35 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:36.736772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:36.737351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:36.746102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.746950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.747389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.748098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.748772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.749442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.824364 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:36.824974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:36.831205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.831921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.832376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.833218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.833654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.834115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.891714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:36.898393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:36.903447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:36.904991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:36.906162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-07925a2c-d2d6-41be-9755-9647e2efde93 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.173349 Sep 07 13:07:36.906788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 106/219] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:36 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:36.906908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d509a314-044c-4e8f-af8b-42a486281a9f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.086222 Sep 07 13:07:36.907264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 114/220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:36 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:36.914331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:36.915004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:36.921149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.921696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.922238 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:36.922950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:36.923396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:36.923809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.061189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:37.070126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e255cb11-2861-4572-bb88-efc65a027b94 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.159612 Sep 07 13:07:37.070706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 107/221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:36 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:37.076339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:37.077023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:37.086010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.086010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.086639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.087624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.088605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.089582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.277902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:37.286632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-83fd4e51-abc2-47cb-a3fa-2d9772b86a65 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.214323 Sep 07 13:07:37.287206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 115/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:37 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:37.935122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:37.935122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:37.944651 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:37.945269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:37.951795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.951795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.951795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.952483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.952962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.953383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.978843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.979353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.979975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:37.980761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:37.981748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:37.982530 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:38.039902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.056391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4a131dd8-537e-4a9e-a6d8-fecd3b0d33a0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.128926 Sep 07 13:07:38.057115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 108/223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:37 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:38.096676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:38.098270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:38.105720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:38.106218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:38.106715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:38.108078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:38.108569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:38.109339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:38.159439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.169447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.171059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.172446 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c85256c5-1149-4370-bf39-4dce2de3002c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.236217 Sep 07 13:07:38.173084 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 116/224] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:37 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:38.270468 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.280077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-02f6baaa-a477-4c75-a3e7-297acfaa6af9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.187284 Sep 07 13:07:38.280568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 109/225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:38 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:38.311469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:38.312992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:38.320314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:38.320917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:38.321356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:38.322184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:38.322813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:38.323271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:38.461396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:38.469771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-109faff4-1e82-46d5-8e96-319265f8a14f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.162079 Sep 07 13:07:38.470346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 117/226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:38 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:39.084861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:39.085480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:39.092372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.092853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.093285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.094007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.094455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.094864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.166344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.176708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ef800b97-bc49-43d1-841f-2415d7bce59f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.095638 Sep 07 13:07:39.177321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 110/227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:39 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:39.198695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:39.199348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:39.201862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:39.202530 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:39.209602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.210113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.210540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.211241 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.212345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.212345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.303061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:39.303990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:39.315845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.316027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.316737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.317882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.318023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.318374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.418176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.434438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.439437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.440666 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-548b3fe5-5f59-4c57-be5f-1191cc92e37f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.246100 Sep 07 13:07:39.449874 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 118/228] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:39 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:39.458721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220b5e26-01bc-4cee-83b3-abe0a93330b4", "name": "network-vif-plugged", "status": "completed", "tag": "63ed0758-4564-4a5f-b057-7bdbda974012"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:39.477648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.478390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.479048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.509898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] Creating event network-vif-plugged:63ed0758-4564-4a5f-b057-7bdbda974012 for instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 on hv-cinder-85331 Sep 07 13:07:39.523833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-3dedcbc6-9220-490d-ba30-9edaa4201bc9 req-bfdad950-889a-4d2a-bfc5-7568bc429a6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067867 Sep 07 13:07:39.524689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.526123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 119/229] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:39.539200 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7416f568-4e3e-46a8-ae1f-56e84d06c041 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.239710 Sep 07 13:07:39.543878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:39.544588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:39.545952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 111/230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:39 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:39.553203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.554070 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.554859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.555740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:39.556195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:39.556776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:39.702527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:39.712771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-41ac1bea-c1d8-485e-b27b-b3da9aae69f7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.184994 Sep 07 13:07:39.713759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 120/231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:39 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:40.201350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:40.203611 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:40.212214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.212943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.213421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.214237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.214773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.215221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.295122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.304637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1393088e-0a48-45bd-ae4c-37c4c2f417ce tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.108129 Sep 07 13:07:40.305306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 112/232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:40 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:40.470484 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:40.471300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:40.478274 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.478891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.479321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.480012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.480455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.480865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.564568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:40.565219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:40.572907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.573646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.574128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.575949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.575949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.575949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.642220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.654692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.656174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.657772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bdd34b93-5268-4d12-906e-73f5378a3f7b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.191851 Sep 07 13:07:40.658680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 121/233] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:40 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:40.736671 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:40.737182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:40.743074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.745011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.745502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.746212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.747042 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:40.747489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:40.747903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:40.751537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ed071e9-b1c8-4cb3-af01-18c7c514f532 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.191752 Sep 07 13:07:40.752320 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 113/234] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:40 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:40.913106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:40.921611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0bbbaeb4-8de6-47b0-845e-0133f073dd0f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.188824 Sep 07 13:07:40.922842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 122/235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:40 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:41.331652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:41.332820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:41.335145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=92 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:41.342237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.343491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.344348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.345812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.346587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.347546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.416249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:41.426966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-650866fb-8248-466f-aa24-7a780b9fec09 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.099227 Sep 07 13:07:41.427577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 114/236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:41 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:41.683690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:41.684312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:41.692275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.692809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.693261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.693981 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.694490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.694907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.775367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:41.775976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:41.782470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.782976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.783402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.784111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.784560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.785448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.834268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:41.843068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:41.844685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:41.845943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-42ba2c54-6e32-4ae8-ac82-0aa6f81f9fb5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.166183 Sep 07 13:07:41.846623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 123/237] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:41 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:41.932027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:41.941697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c3e84de4-645d-4127-804b-6a08c38cfe8a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.170212 Sep 07 13:07:41.942284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 115/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:41 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:41.948173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:41.948962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:41.955211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.955670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.956400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:41.957229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:41.958102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:41.958527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.097793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:42.106337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ee11f91a-1cf3-47e4-9971-c3a40e754395 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.162315 Sep 07 13:07:42.106921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 124/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:41 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:42.453028 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:42.453625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:42.460926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.461433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.461909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.462625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.463059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.463482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.530253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:42.539137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8c02ae86-ac0c-4294-bf4e-15fac8208655 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.090276 Sep 07 13:07:42.539717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 116/240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:42 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:42.871418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:42.872011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:42.881097 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.881585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.882043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.882738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.883182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.883593 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.965751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:42.966398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:42.973730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.974253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.974683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:42.975353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:42.975816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:42.976230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:43.058114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.068848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.071006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.072597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c67df265-78c5-4573-99cb-43606ff30a26 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.205122 Sep 07 13:07:43.073858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 125/241] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:42 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:43.130419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:43.131031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:43.135145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.137532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:43.138013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:43.138296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:43.138412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:43.139209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:43.139634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:43.140111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:43.146333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0aa0f4ac-7497-4c4a-9b87-da980b16c00e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.184406 Sep 07 13:07:43.146924 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 117/242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:42 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:43.299728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.310110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-29c4de33-c22e-4e7e-aef5-fe2d13f75251 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.184288 Sep 07 13:07:43.310689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 126/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:43 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:43.563815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:43.565179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:43.574354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:43.575025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:43.575463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:43.576170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:43.576614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:43.577037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:43.649506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:43.657687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-34e05cf0-71df-4136-9e9d-446fa4d2ed9e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.098049 Sep 07 13:07:43.658295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 118/244] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:43 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:44.099845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:44.100752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:44.118019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.118686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.119512 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.120735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.121438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.122132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.142169 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:44.172430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:44.173437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:44.180570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.181138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.181852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.182624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.183140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.183766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.283711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.293571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.295604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.297543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-835c64e8-9c0c-49fe-8bf1-44b67fa1bf5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.202619 Sep 07 13:07:44.298932 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 127/245] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:44 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:44.335552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:44.336175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:44.339117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.342663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.343158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.343596 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.344299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.344751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.345427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.346839 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a2e71000-ccc5-4c9c-9a87-03a3064e79a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.178374 Sep 07 13:07:44.347453 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 119/246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:44 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:44.502345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.541207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2602a3e8-0b51-4a26-a7d6-949a902ecd13 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.210054 Sep 07 13:07:44.553793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 128/247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:44 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:44.681354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:44.682708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:44.693766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.695907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.696712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.697921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.698381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.698838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.774761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:44.783060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5af895fb-4015-4966-8c79-ab9478be766e tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1267 microversion: 2.1 time: 0.106006 Sep 07 13:07:44.783637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 120/248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:44 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:45.325308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:45.325988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:45.332990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.333492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.334097 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.334835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.335357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.336147 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.372945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:45.374610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:45.389585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.391386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.392067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.394423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.395250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.395937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.500826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.509562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.511045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.512334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-910c111d-7a50-4e78-87f9-8ed951c3f7ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.192192 Sep 07 13:07:45.512895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 129/249] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:45 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:45.566721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.574590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:45.575502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:45.575746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-307092a6-021e-43f2-8035-9c4ce9a8fd90 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.209028 Sep 07 13:07:45.580765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 121/250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:45 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:45.582334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.582691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.583256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.584017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.584471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.584886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.730190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.743712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0c2a669b-1083-4ff7-930f-612b4052340a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.174844 Sep 07 13:07:45.744740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 130/251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:45 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:45.806638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:45.807303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:45.820588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.821080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.821503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.822227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:45.822670 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:45.823081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:45.893955 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:45.904240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7b8cae3c-18f3-4a87-a248-7879692752d0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1275 microversion: 2.1 time: 0.101527 Sep 07 13:07:45.905446 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 122/252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:45 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:46.539234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:46.539818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:46.546347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.547065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.547533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.548214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.548669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.549066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.614281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:46.615445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:46.634403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.635484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.636017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.637032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.637625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.638304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.737953 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:46.755784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:46.757260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:46.759285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6af9d3c7-b31d-47cc-8f05-29ee5e5f5520 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.223850 Sep 07 13:07:46.760991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 131/253] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:46 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:46.777043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:46.778660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:46.795902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.797009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.798052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.799823 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:46.801173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:46.802800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:46.990934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:47.002666 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f28e9b40-be2a-4090-95b1-389f6f17c3c9 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1368 microversion: 2.1 time: 0.394712 Sep 07 13:07:47.025698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 123/254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:46 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:47.032735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:47.033386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:47.043726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:47.044517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:47.045081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:47.046151 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:47.046958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:47.047646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:47.148119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:47.163863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-392fff21-b9f8-4f29-a749-c101c2055353 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1285 microversion: 2.1 time: 0.145932 Sep 07 13:07:47.178404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 124/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:47 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:47.260768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:47.281230 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a3116c35-617d-4838-a98d-79b8a5d22698 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.513152 Sep 07 13:07:47.286797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 132/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:46 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:47.786479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "name": "network-vif-plugged", "status": "completed", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:47.791621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:47.792425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:47.800924 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:47.801749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:47.802386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:47.809568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:47.810574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:47.812175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:47.813302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:47.814034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:47.814752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:47.827292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] Creating event network-vif-plugged:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:07:47.835027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-1b4567ab-dbc7-4813-9f90-a81eda634f80 req-a32a466e-dd5e-4e02-85fc-a0eeafafd57b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053995 Sep 07 13:07:47.836032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 125/257] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:48.047825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:48.054345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:48.056553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.074911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.077171 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.078401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8d2a5e15-abfc-42ba-9995-a91e90bb6394 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.293933 Sep 07 13:07:48.078956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 133/258] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:47 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:07:48.079483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.085881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.086645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.088404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.089173 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.089910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.203382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:48.203995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:48.213081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.214254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.215024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.216754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.217632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.218488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.393969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.421942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.422945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5ed7b9ac-ac34-44a3-b8e0-28ed2cf083b3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1558 microversion: 2.1 time: 0.384444 Sep 07 13:07:48.425662 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 126/259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:48 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1558 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:48.439583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:48.445982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:48.449535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9c85d19a-ed43-48d5-ad88-87ab13d95e6a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1273 microversion: 2.1 time: 0.248095 Sep 07 13:07:48.454209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 134/260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:48 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:48.460502 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.461375 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.462152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.463046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:48.463645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.464072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:48.464517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.465150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.473141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.474774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.475370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.477091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:48.477561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:48.478016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:48.672007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:48.688307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f991ea5d-3803-4601-b3d5-7d9fec74faf5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.256323 Sep 07 13:07:48.689413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 127/261] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:48 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:48.710053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-33d2458f-e7b8-4793-9a1f-b435cd623569 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250331 Sep 07 13:07:48.711301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 135/262] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:07:48 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:49.107507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:49.108390 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:49.122139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.123159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.125346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:49.126945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.128834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.142619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:49.483749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:49.484354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:49.490746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.491556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.492168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:49.493065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.493811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.494468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:49.595039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:49.603495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-26850ade-4c1f-42ce-805f-c0d78c6217f8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1273 microversion: 2.1 time: 0.123487 Sep 07 13:07:49.614757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 136/263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:49 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:49.716996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:49.717734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:49.733541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.734436 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.742234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:49.743478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:49.745807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:49.747668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:50.010872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.051939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.068535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.073890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-67d01100-3d3c-4b81-95e4-5163d1d7ed02 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1408 microversion: 2.20 time: 0.970925 Sep 07 13:07:50.076251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 128/264] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:49 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1408 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:50.307343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.326026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cdf99c8c-12a7-4f9a-a162-ee4b6b03b0c6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.613358 Sep 07 13:07:50.333561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 137/265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:49 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:50.636655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:50.640071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:50.655763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:50.656526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:50.657117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:50.658061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:50.658659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:50.659907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:50.925737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.942375 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0dfdf3bd-c3dc-43bd-88be-34ad043accd8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.313216 Sep 07 13:07:50.943140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 129/266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:50 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:51.129007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.129604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:51.136139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.136863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.137479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.138373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.138969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.139537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.271107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220b5e26-01bc-4cee-83b3-abe0a93330b4", "tag": "63ed0758-4564-4a5f-b057-7bdbda974012"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:51.288870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.289617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.290217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.309842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] Creating event network-changed:63ed0758-4564-4a5f-b057-7bdbda974012 for instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 on hv-cinder-85331 Sep 07 13:07:51.316472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-2343cc0a-e106-4b48-80c6-4bda9a91a0bc req-1bdfb945-bd42-4efa-9001-ede90058e822 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049851 Sep 07 13:07:51.317448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 130/267] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:51.360519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.361449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:51.372286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.373052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.373703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.374766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.375584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.376771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.535835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:51.556210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:51.562487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:51.563729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e30feda6-a263-4c48-a7f2-d12a8d349ca3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1600 microversion: 2.20 time: 0.438798 Sep 07 13:07:51.565968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 138/268] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1600 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:07:51.611038 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.611633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:51.619950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.620970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.621534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:51.621879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.622907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.623553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.624363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.634141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e37ece3a-c49c-43c8-8258-6c4a0d3beb7a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.278341 Sep 07 13:07:51.654531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 131/269] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:51.827082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a455ef5f-9b9e-45ca-8b10-c16732ce7ebd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.220433 Sep 07 13:07:51.827915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 139/270] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:07:51.970880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.971493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:51.988308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.989413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.990362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.991356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.992171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.992742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:52.209473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:52.223003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-08aaf37c-9dbb-455b-9b5a-b9e7ff89e9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.255068 Sep 07 13:07:52.228407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 132/271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:52.660825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:52.662082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:52.672707 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:52.675061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:52.675631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:52.679088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:52.679680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:52.680301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:52.922366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91c9404-a193-46e3-b8f2-5164728ce0be", "tag": "6d7f4a81-be9b-42fd-b7f3-e8541714e710"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:52.937020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:52.937749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:52.938351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:52.954169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] Creating event network-changed:6d7f4a81-be9b-42fd-b7f3-e8541714e710 for instance c91c9404-a193-46e3-b8f2-5164728ce0be on hv-cinder-85331 Sep 07 13:07:52.960991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-f067a8f6-1b19-4234-a9e6-42ff1821e3e7 req-77d49aa9-52ba-485d-8c83-a42dcc3e0796 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042474 Sep 07 13:07:52.965824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 133/272] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:53.142399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:53.152798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fd8afec9-7553-4083-9f8c-a970cf70f479 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.496727 Sep 07 13:07:53.153385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 140/273] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:52 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:53.255848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:53.256931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:53.263840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:53.264183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:53.264844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:53.265884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:53.267082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:53.267792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:53.487469 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:53.497517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5a7e41ad-f40a-4bef-9f73-53a04a7894c2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.246439 Sep 07 13:07:53.511195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 134/274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:53 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:54.177033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:54.177754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:54.184340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:54.184888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:54.185570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:54.186702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:54.187128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:54.187761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:54.374991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:54.406888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f40c9ee6-182c-499a-9280-d1ea57a5b8e0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.233922 Sep 07 13:07:54.408101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 141/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:54 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:54.525828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:54.527269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:54.536731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:54.537217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:54.537899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:54.538778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:54.539377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:54.539984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:54.727066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:54.735210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8a793a29-75a5-41b9-925e-dcdea86b4d7a tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.216089 Sep 07 13:07:54.736373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 135/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:54 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:54.991894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:55.007036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.007813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.008579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.173725 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] Creating event network-changed:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:07:55.179637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-9e162c26-2852-4760-8f48-15e818cb6826 req-f4b033fe-3606-495a-b849-9cc9815972b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192871 Sep 07 13:07:55.180891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 142/277] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:55.430722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:55.431318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:55.438373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.438969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.439437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.440155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.440695 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.441211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.463451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:55.583729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:55.591693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-43b15a3b-ef6c-4665-b1b1-ea2e5638b2d7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.164942 Sep 07 13:07:55.592260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 136/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:55 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:55.774937 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:55.775635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:55.782071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.782539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.782973 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.783664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.784118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.784529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.927867 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:55.936099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5badd5f5-1a29-4465-a7fa-bbf170189976 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.165511 Sep 07 13:07:55.936671 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 143/279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:55 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:56.615873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:56.616639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:56.623533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:56.624029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:56.624456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:56.625155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:56.625605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:56.626066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:56.766548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:56.775657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-895af8f0-b799-4d8b-8c84-a54a0a996b8a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.163648 Sep 07 13:07:56.776229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 137/280] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:56 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:56.959085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:56.959722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:56.966120 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:56.966608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:56.967034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:56.967729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:56.968177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:56.968589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:57.109025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:57.117248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8a578bce-778d-4444-a172-853323f1ab4f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.162348 Sep 07 13:07:57.117860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 144/281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:56 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:57.803264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:57.804116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:57.811936 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:57.812616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:57.813236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:57.814712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:57.815283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:57.815986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:58.080559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:58.088673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f721b58b-b3d9-4873-9871-d2adca3b36a2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.291787 Sep 07 13:07:58.089529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 138/282] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:57 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:58.139680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:58.140700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:58.148866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:58.149444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:58.150101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:58.150862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:58.151377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:58.151999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:58.170786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:58.320547 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:58.333977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e27cb8e7-c337-4fa9-8aa4-2a8371957bdc tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.197831 Sep 07 13:07:58.335009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 145/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:58 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:59.095622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.096507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:59.104475 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.104971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.105407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.107778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.108295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.108926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.117629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.119183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:59.127950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.128558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.129159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.130058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.130580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.131014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.144288 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:07:59.286249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-09bda566-9de0-409f-9f72-a62cb14a0dc4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 204 len: 0 microversion: 2.1 time: 0.192970 Sep 07 13:07:59.287623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 139/284] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:07:59 2022] DELETE /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:07:59.309444 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.310361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:59.320805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.321293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.321777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.322462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.322908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.323319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.330139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:59.345009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b674db69-b2e0-4a2d-ad61-1b3c47037984 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.235574 Sep 07 13:07:59.345986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 146/285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:59 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:59.358915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.359717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:59.367630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.368317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.369019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.369898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.370500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.371201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.494013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:59.503262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0a7e7f5c-c3d7-45a8-8f6b-f42f8bc27486 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.199582 Sep 07 13:07:59.503916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 140/286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:59 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:59.509273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-275064810", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "networks": [{"uuid": "546b12c3-eadf-45e8-b433-886beccf35ac"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:59.552492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:59.561594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-663ce5e8-7e33-4da8-a317-dcdf93c59bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.207029 Sep 07 13:07:59.562678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 147/287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:59 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:07:59.734083 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] validate_networks() for [('546b12c3-eadf-45e8-b433-886beccf35ac', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:08:00.113051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:08:00.113942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:08:00.114069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:08:00.114388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:08:00.114791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:08:00.124221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.124699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.125131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.125892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.126346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.126768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.144372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Getting quotas for project 4da3acfcc34b44a5909e036705c040c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:08:00.148679 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Getting quotas for user 86032a9fd3b8429b99a7d23ddaf03116 and project 4da3acfcc34b44a5909e036705c040c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:08:00.160074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:08:00.163950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:08:00.231267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4ff9824d-a501-4926-9b92-5ca4515ccf35 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726091 Sep 07 13:08:00.232137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 141/288] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:08:00.244572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c865cc44-9ebc-44b9-90d0-d8956da0076d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:00.245575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c865cc44-9ebc-44b9-90d0-d8956da0076d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:00.306296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c865cc44-9ebc-44b9-90d0-d8956da0076d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:00.313711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c865cc44-9ebc-44b9-90d0-d8956da0076d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1213 microversion: 2.1 time: 0.073353 Sep 07 13:08:00.314505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 148/289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:00 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:00.373408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:00.374444 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:00.382089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.382250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.382579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.383366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.384069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.385423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.534150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:00.536672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:00.547434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.548679 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.549798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.551616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.552721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.553855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.593804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:00.614324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-172b865a-b25e-483a-a4c2-181b49947c69 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.244715 Sep 07 13:08:00.615403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 142/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:00 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:00.624964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:00.626600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:00.639719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.642746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.643844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.645194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:00.646092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:00.646876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.802134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:00.817251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-08d3b9a9-7968-4a0f-9db6-0b7487b7ab9a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.290433 Sep 07 13:08:00.818284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 149/291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:00 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:00.893022 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:00.903415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-44e785c7-6378-4d62-a45b-feed7a68c3d8 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.286139 Sep 07 13:08:00.904160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 143/292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:00 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:01.337032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:01.337848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:01.345349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.346011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.346544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.347340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.347928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.348439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.423881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:01.436037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-270a047e-d8b0-4d23-9a41-a1df2ca8b023 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1217 microversion: 2.1 time: 0.102844 Sep 07 13:08:01.436974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 150/293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:01 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:01.657855 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:01.659062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:01.670454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.671316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.672085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.673329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.674193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.674963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.846341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:01.847497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:01.858962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.859800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.860583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.861996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.862865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.863685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.883215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:01.893875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-239df592-8520-4ebd-b8d5-6fed7637f10f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.242778 Sep 07 13:08:01.894898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 144/294] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:01 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:01.930947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:01.932060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:01.943716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.944364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.944887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.945746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.946277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.946778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:02.101872 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:02.117183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-badb9620-1fdb-41a4-bc85-aafcda445892 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.278028 Sep 07 13:08:02.118428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 151/295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:01 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:02.163543 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:02.175341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9215b583-e601-48ea-8e57-75da7de2acb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.250441 Sep 07 13:08:02.176136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 145/296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:01 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:02.464817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:02.465589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:02.472779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:02.473452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:02.474078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:02.474887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:02.475429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:02.475935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:02.571127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:02.591224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-973f3cdd-a137-468e-b75b-674514dc621f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1217 microversion: 2.1 time: 0.130272 Sep 07 13:08:02.600591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 152/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:02 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:02.924382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:02.925355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:02.937178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:02.938037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:02.938773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:02.940001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:02.940828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:02.941614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.153310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:03.154168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:03.162393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.163015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.163594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.164630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.165261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.165886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.390281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:03.409185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f4222597-9e60-4e0e-83ef-d77e0722d898 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.258945 Sep 07 13:08:03.410176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 153/298] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:03 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:03.419124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:03.420198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:03.431506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.432399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.433194 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.434527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.435406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.436966 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.482303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:03.492942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d4ea7386-2f85-48f4-a6b9-0bf1ce4b41fc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.576029 Sep 07 13:08:03.493820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 146/299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:02 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:03.629966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:03.631224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:03.638774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.639430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.639968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.640785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.641346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.642089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.650497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:03.668568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8800549f-61f6-453b-91ec-d5e44bd989c1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.256402 Sep 07 13:08:03.669418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 154/300] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:03 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:03.747650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:03.761879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9903acdf-9ca0-46aa-9bdd-c88aff8d0699 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1217 microversion: 2.1 time: 0.140425 Sep 07 13:08:03.762905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 147/301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:03 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:04.452523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:04.453601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:04.457295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=96 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:04.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.467770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.468483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.469693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.470477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.471177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.539995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:04.540920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:04.560001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.560987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.561510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.562450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.563053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.564020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.796163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:04.812110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-79a63131-3550-4ffa-b06e-edc0d887109e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.279258 Sep 07 13:08:04.814208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 148/302] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:04 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:04.835990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:04.837155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:04.849321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.850216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.850975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.852324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.853183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.854000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:05.074263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:05.089840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9a05d0bc-5a92-45b6-900d-d12dc99c5640 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.644176 Sep 07 13:08:05.090799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 155/303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:04 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:05.091368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:05.100330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:05.101401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:05.106661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d4eab225-1a3b-45aa-af78-1283f15834ab tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.290169 Sep 07 13:08:05.107602 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 149/304] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:04 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:05.112045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:05.112919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:05.113765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:05.114969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:05.116059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:05.117060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:05.221031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:05.236497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-271097d2-c35b-41e3-98f3-44df283a63ef tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1217 microversion: 2.1 time: 0.143737 Sep 07 13:08:05.237399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 156/305] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:05 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:05.856264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:05.857377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:05.869863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:05.871124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:05.872196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:05.875753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:05.877123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:05.878092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.126808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:06.127511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:06.139229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.140051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.140842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.141152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:06.142020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.143116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.144174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.155130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2c356765-24a4-4cb1-a5a0-8cec774e9819 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.305855 Sep 07 13:08:06.156953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 150/306] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:05 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:06.186544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:06.187502 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:06.198504 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.199123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.199564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.200609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.201359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.202399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.412855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:06.430619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fd95fde7-8bc0-482c-91e5-fae0e4f7bc3d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.309800 Sep 07 13:08:06.434487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 157/307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:06 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:06.455023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:06.457284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:06.477029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.478493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.480109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.482248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.483548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.484198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.541496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:06.559312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c24fc2b5-f02d-4371-9ba0-96e5b651c669 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.392114 Sep 07 13:08:06.560393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 151/308] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:06 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:06.633303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:06.650654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ea2f8719-5356-4a26-8233-798bedfb2811 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1209 microversion: 2.1 time: 0.213541 Sep 07 13:08:06.653438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 158/309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:06 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1209 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.206500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.207554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:07.223055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.223987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.224695 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.226100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.226100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.226100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.270415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:07.488004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.492588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:07.510711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.511987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.513876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.515554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.516578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.517472 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.546991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:07.567462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9f2fb20a-fa82-4deb-bec3-2fe7ceb8da10 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.376719 Sep 07 13:08:07.581752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 152/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.600229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.601811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:07.614655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.616449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.621599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.625417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.627548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.628808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.800928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:07.831745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e9271946-0452-4584-bab7-2fb7bc8bcdb9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.358706 Sep 07 13:08:07.834268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 159/311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.843597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.844752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:07.858414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.859551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.860295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.861286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.862019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.862695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.913774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:07.923264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5862fff1-ef55-4692-a793-e7ae445cc9f7 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.330783 Sep 07 13:08:07.924401 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 153/312] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.962628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:07.976685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1456328d-1c0d-4128-8f16-321ec49ef88d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.140135 Sep 07 13:08:07.977650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 160/313] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:08.625147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:08.626188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:08.630040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:08.640402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.641254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.642094 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.643390 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.644526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.645254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.865517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:08.866779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:08.879849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.880656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.881735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.883033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.883763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.884279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.907785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:08.921120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c045c0cb-d4cb-4371-8c31-ca53a3f7d7ce tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.302711 Sep 07 13:08:08.921857 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 154/314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:08 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:08.962576 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:08.963274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:08.970351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.970997 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.971529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.972348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:08.972993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:08.973618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:09.089500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:09.099015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-196e7790-a3d4-48a5-9f1e-d0efe2e666f3 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.241537 Sep 07 13:08:09.100675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 161/315] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:08 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:09.105298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:09.106178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:09.114700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:09.115602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:09.116364 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:09.117587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:09.118415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:09.119123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:09.220745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:09.223908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:09.238697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3dfcbd78-4f72-4967-9da6-1b10ef541243 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.281520 Sep 07 13:08:09.239948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 155/316] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:08 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:09.244732 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9416934b-8129-4c3b-a24c-5e83a13b5e87 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.142744 Sep 07 13:08:09.246180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 162/317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:09 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:09.955592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:09.956808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:09.971213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:09.972380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:09.973830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:09.975014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:09.975851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:09.976601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.135087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.149570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:10.151011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:10.155573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.168117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.169103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.170000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.171338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.172188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.172981 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.181546 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.222386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:10.236849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2a39251f-fea7-4782-b4b7-666e73807016 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.288351 Sep 07 13:08:10.238131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 156/318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:09 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:10.269962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:10.270894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:10.282898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.283229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.283794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.285227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.286075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.289393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.311005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:10.429727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:10.448863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5217a8c9-3685-4950-997c-f2da5c09c41d tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.304765 Sep 07 13:08:10.449961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 163/319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:10 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:10.459289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:10.460455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:10.471935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.472876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.473664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.475011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.476152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.476942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.548211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:10.561884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-94f1b2b8-6182-41c3-a1b0-872969edcfd2 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.297049 Sep 07 13:08:10.563097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 157/320] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:10 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:10.599026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:10.614109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-49fb5cac-5996-44b6-ad95-adcc901b79ba tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.162184 Sep 07 13:08:10.615402 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 164/321] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:10 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:11.268583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:11.271136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:11.285437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.285437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.285437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.287037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.287863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.288643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.491843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:11.492978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:11.504450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.504450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.505838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.507121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.507902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.508677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.526349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:11.541495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cb98a156-3ae9-4d9c-ae22-d7cbcbc00d91 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.280346 Sep 07 13:08:11.542552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 158/322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:11 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:11.597966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:11.599521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:11.610906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.611762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.612537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.613965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.614816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.615583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.749790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:11.766073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-be198472-330a-47eb-affd-c089163f9abd tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.282696 Sep 07 13:08:11.767113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 165/323] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:11 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:11.776989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:11.778064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:11.795586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.796396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.797179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.798773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.800045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.800999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.842571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:11.856430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-20d83c6b-da4a-4533-83c8-81fd28778f01 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.265432 Sep 07 13:08:11.857532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 159/324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:11 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:11.910669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:11.924702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c10b722a-2e2a-4bc2-a670-9dba880d3db8 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.155733 Sep 07 13:08:11.925843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 166/325] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:11 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:12.578722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:12.579693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:12.590797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.591676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.592369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:12.593518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.594346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.595021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:12.795190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:12.809762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-76641fb5-85af-44a3-8ecb-7e9f158bb6b7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.237286 Sep 07 13:08:12.810754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 160/326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:12 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:12.813602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:12.817845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:12.831286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.832213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.833002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:12.834345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.835250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.836073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:12.911604 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:12.912715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:12.924289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.925115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.925951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:12.927218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:12.928319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:12.929086 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:13.088523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:13.106643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-232bb5f1-c350-4772-b707-00e6795ebd61 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.300187 Sep 07 13:08:13.107733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 167/327] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:12 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:13.118685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:13.121267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:13.135565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:13.136185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:13.136809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:13.137826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:13.138422 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:13.138958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:13.179261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:13.193935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ea9e5887-9d90-4023-b1e6-3c31ed15b9ec tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.289670 Sep 07 13:08:13.195014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 161/328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:12 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:13.242325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:13.254865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cd5101e1-7f91-4cf8-998e-9b3f4c9f7338 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.145077 Sep 07 13:08:13.255669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 168/329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:13 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:13.843087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:13.844145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:13.856501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:13.857442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:13.858344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:13.860205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:13.861193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:13.862342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.075223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:14.091471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-454c454a-650b-4498-a79b-9fb4e509f823 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.252295 Sep 07 13:08:14.092592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 162/330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:13 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:14.145537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:14.146649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:14.155386 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.156214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.156977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.158512 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.159340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.160128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.241393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:14.242864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:14.254089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.255589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.256224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.257739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.258699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.259532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.415388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:14.435062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-82ea7722-8dfe-4795-a6ca-bbea9f853091 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.294914 Sep 07 13:08:14.437518 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 169/331] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:14 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:14.452350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:14.453779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:14.475609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.476457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.477222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.478432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.479091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.479662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.545352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:14.560888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4509f60b-a3d4-401e-8e7c-5afe3d7b973f tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.326743 Sep 07 13:08:14.561912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 163/332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:14 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:14.613771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:14.630844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cfbef8e8-036e-48ff-a24e-99939a06b36d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.190949 Sep 07 13:08:14.635527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 170/333] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:14 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:15.126186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:15.127292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:15.140265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.141024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.141775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.143092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.143975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.145306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.388978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:15.403910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ef14f29b-8f0e-42a6-92ea-a5e8795e2de0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.288033 Sep 07 13:08:15.412503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 164/334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:15 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:15.491349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:15.493923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:15.506217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.507199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.508262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.509632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.510548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.511284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.602533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:15.603830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:15.634765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.635589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.636456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.638155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.639178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.640097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.917356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:15.956639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8b042b59-fab4-4cae-bfc7-a0821f3aaf69 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1554 microversion: 2.1 time: 0.480539 Sep 07 13:08:15.959456 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 171/335] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:15 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1554 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:16.031731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:16.032795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:16.071109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:16.072005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:16.083219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:16.084744 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:16.085721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:16.086926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:16.167241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:16.196965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6be3c378-57aa-464a-a4dc-f6182845eda9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.602244 Sep 07 13:08:16.202861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 165/336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:15 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:16.400689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:16.422119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-149e4fb9-3db8-4934-a2a1-653b9b10564a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.460070 Sep 07 13:08:16.423081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 172/337] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:15 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:16.457981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:16.459157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:16.477728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:16.478596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:16.479420 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:16.480845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:16.481732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:16.482840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:16.885329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:16.901070 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2ccb8d06-de2f-44e1-acc6-4d31780a6f5e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.451844 Sep 07 13:08:16.902346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 166/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:16 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:17.006163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.007158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:17.018823 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.020582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.021501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.022712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.023373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.023974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.144026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:17.169040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6d3b76fc-690e-4d30-9232-69aae4ed2d0e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.172007 Sep 07 13:08:17.171110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 173/339] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:16 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:17.259488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a43fa6-feee-46eb-8439-0ab5e631ab83", "name": "network-vif-deleted", "tag": "689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:17.259756 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.261491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:17.271988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.272792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.273536 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.274516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.275133 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.275304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.275773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.276069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.276852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.339293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] Creating event network-vif-deleted:689e62cc-dd9b-4b9c-ab28-fc7a5d4e360f for instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 on hv-cinder-85331 Sep 07 13:08:17.339293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-b14d2e5f-ab46-4ed4-a2c8-e33d3184c91e req-e266bb25-0b2a-451e-8a73-44a371da6112 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077796 Sep 07 13:08:17.339293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 174/340] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:17.471797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.473464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:17.487005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.488064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.488866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.490230 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.491085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.491822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.554898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:17.571610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-37081805-d186-44b9-b693-d1d75c68ea56 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.322826 Sep 07 13:08:17.572454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 167/341] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:17 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:17.620739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:17.641282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d92664bf-129c-4479-8ed9-bf993f860a34 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.181780 Sep 07 13:08:17.642384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 175/342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:17 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:17.954194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.955367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:17.974052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.974840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.975541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.976768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.977506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.978431 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.214113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:18.215094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:18.227614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:18.227920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.228313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.228811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.229602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.230277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.230768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.233729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:18.243911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-41cfb78e-0502-40cc-b405-a715a7606206 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.297882 Sep 07 13:08:18.244911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 168/343] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:17 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:18.335736 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:18.351231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-33a5e1ce-c490-4b42-8075-6f9be7416ee7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.145370 Sep 07 13:08:18.351972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 176/344] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:18 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:18.607157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:18.608256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:18.621726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.622637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.623429 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.624699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.625541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.626365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.681541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:18.682283 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:18.690453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.691288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.692135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.693086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.693914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.694653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.813265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:18.826224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-344e7812-88e4-4b9a-add1-c0d6f23e7d9c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.150704 Sep 07 13:08:18.827264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 177/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:18 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:18.904100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:18.916117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-686ce981-b6b5-4156-bd00-2f71841eed18 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.316777 Sep 07 13:08:18.916890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 169/346] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:18 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:19.284110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:19.285198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:19.294641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.295201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.295760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.296541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.297104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.297629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.393118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:19.394174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:19.406270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.407194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.408017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.409412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.410507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.411527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.537523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:19.545182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:19.555743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d5a3521d-96c6-4e91-ba7b-ac84f256e35c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.277134 Sep 07 13:08:19.556373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 178/347] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:19 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:19.562311 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9bf78ff0-3b2d-42a0-9978-09c9cb4b4694 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.176216 Sep 07 13:08:19.563398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 170/348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:19 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:19.867505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:19.868559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:19.880739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.881619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.882481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.883780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.884636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.885415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.946879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:19.947957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:19.959241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.960055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.960757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.961999 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:19.962770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:19.963449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.998001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:20.009335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-74269cfe-a98f-4b8e-ab7c-7c9a6165665f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.149501 Sep 07 13:08:20.010845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 179/349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:19 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:20.188901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:20.200771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cbaad613-a54e-466d-b4d0-766011d56bb0 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.261028 Sep 07 13:08:20.201744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 171/350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:19 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:20.586466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:20.587590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:20.599189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:20.599535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.600182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:20.600391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.601172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:20.602445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.603293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.604009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:20.613038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.614018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.614825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:20.616150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.616998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.617802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:20.637473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:20.745594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:20.766139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ac578f4-356e-4c85-a44a-2bfdf0fa5069 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.173179 Sep 07 13:08:20.766866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 172/351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:20 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:20.850293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:20.864039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4c812949-4bfe-4578-973b-4dc5c93fdfbc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.284381 Sep 07 13:08:20.865089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 180/352] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:20 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:21.052893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:21.054527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:21.068820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.069723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.070871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.072145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.072894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.073591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.191464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:21.205000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a1c98c25-3d59-43e8-a5dc-4a42a58cd407 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.160048 Sep 07 13:08:21.206117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 173/353] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:21 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:21.231944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:21.232651 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:21.241634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.247786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.248314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.249184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.249783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.250289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.499398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:21.513992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-09427293-2f89-4f7b-b023-9a611e1d7950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.288439 Sep 07 13:08:21.514991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 181/354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:21 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:21.796482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:21.797522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:21.807763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.808596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.809330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.810493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.811223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.811920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.897340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:21.898206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:21.908990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.909857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.910942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.911767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.912515 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.913207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:21.913369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.927752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-18e7ca9a-f095-496e-a3da-449a52b99003 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.136803 Sep 07 13:08:21.932718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 174/355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:21 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:22.132055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:22.146253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7ef83c91-7871-41ac-bcc0-4afb25dc1d83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.253937 Sep 07 13:08:22.147225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 182/356] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:21 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:22.242111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:22.243302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:22.265051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.265943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.266712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.268000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.268856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.269978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.389394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:22.402381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e0e695e2-a10b-4aaa-8f08-f0fc13b78a17 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.167479 Sep 07 13:08:22.403342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 175/357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:22 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:22.549519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:22.550687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:22.562919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.563789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.564896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.566403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.567345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.568370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.814589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:22.829894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3d09671c-4d8e-4a59-adc0-d1ff4389d1bb tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.288964 Sep 07 13:08:22.830870 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 183/358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:22 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:22.971925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:22.973011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:22.983821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.984676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.985460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.986771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:22.987273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:22.987715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.105278 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:23.121002 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-44c90ab5-4260-425b-a081-ba5545e98bd1 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.153715 Sep 07 13:08:23.121002 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 176/359] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:22 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:23.189308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:23.190279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:23.199488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.200319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.200826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.201589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.202088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.202518 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.435827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:23.436868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:23.454124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:23.454649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.455736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.457809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.464302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.465460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.466299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.467322 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d3cfe758-ce88-465e-9f37-6755063a4b29 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.284276 Sep 07 13:08:23.468746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 184/360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:23 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:23.570390 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:23.584804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-73b453fe-4f8f-4633-8254-498cf3c02309 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.155544 Sep 07 13:08:23.585808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 177/361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:23 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:23.860568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:23.861391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:23.873173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.874032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.874701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:23.875849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:23.876557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:23.877247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.105139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:24.115250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-33966563-4abb-41ca-8bb6-798bc13b4c99 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.261385 Sep 07 13:08:24.115838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 185/362] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:23 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:24.165263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:24.166575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:24.178891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.179788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.180591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.181937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.182778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.183554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.288454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:24.299833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-533a386e-e155-41cf-a924-e1544d78f0ad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1512 microversion: 2.1 time: 0.141712 Sep 07 13:08:24.300781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 178/363] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:24 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:24.515048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:24.516049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:24.527130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.527836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.528611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.529772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.531091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.531453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.630364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:24.631589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:24.644167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.645451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.646837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.648312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:24.649303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:24.650266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:24.812863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:24.851751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-14dfae94-d06f-4512-af01-94744f8bb6e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1265 microversion: 2.1 time: 0.232737 Sep 07 13:08:24.864904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:24.869630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 179/364] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:24 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:24.903196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8da11b67-e2b4-4a8d-9468-a784b3bf3219 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.386881 Sep 07 13:08:24.904879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 186/365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:24 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:25.145731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:25.146794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:25.155526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.156210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.156944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.163830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.163830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.163830 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.231261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91c9404-a193-46e3-b8f2-5164728ce0be", "name": "network-vif-plugged", "status": "completed", "tag": "6d7f4a81-be9b-42fd-b7f3-e8541714e710"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:25.249092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.250047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.250708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.276434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] Creating event network-vif-plugged:6d7f4a81-be9b-42fd-b7f3-e8541714e710 for instance c91c9404-a193-46e3-b8f2-5164728ce0be on hv-cinder-85331 Sep 07 13:08:25.305905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-013c81f2-f3dd-4be2-8c4f-1b5b8b70ed64 req-9025509e-3e5e-466d-b818-e78efee0bc21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082097 Sep 07 13:08:25.307345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 187/366] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:25.347598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:25.360538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:25.393149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.395028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.396381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.398667 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.399923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.401856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.587892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:25.636669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-01a89bc9-ea9b-43a6-8a3e-5fe73fe554e1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.496994 Sep 07 13:08:25.650119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 180/367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:25 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:25.687896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:25.704981 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ebe492b7-15f7-43bb-b81e-a2c1a7e06624 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1346 microversion: 2.1 time: 0.376554 Sep 07 13:08:25.726632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 188/368] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:25 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1346 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:25.916439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:25.924114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:25.934177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.934991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.935659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.936667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.937544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.951150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:25.952000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.956795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:25.983797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.984909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.990047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:25.994378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:25.996884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:25.998295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.119994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:26.132224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c053e4f1-675d-480c-810d-ca4a396eef66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1283 microversion: 2.1 time: 0.228700 Sep 07 13:08:26.135491 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 181/369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:25 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:26.297979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:26.316307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-967fa40d-fef4-4a26-a922-883c9c582133 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.374460 Sep 07 13:08:26.317156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 189/370] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:25 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:26.701417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:26.703388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:26.722338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:26.723268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:26.726016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.727739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:26.729109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:26.730332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.756797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:26.761546 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:26.794774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:26.794774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:26.794774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.794774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:26.807161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:26.811445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.894015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:26.895407 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:26.896024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:26.896811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:27.045722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:27.060246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7b0df343-9798-4d75-b73c-216f1dfca860 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.374877 Sep 07 13:08:27.061170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 182/371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:26 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:27.084891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:27.102653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-34f78780-52e1-41b7-b5b2-db83e71153d7 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.357931 Sep 07 13:08:27.104158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 190/372] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:26 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:27.177945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:27.179130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:27.191023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:27.191992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:27.192843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:27.194248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:27.195092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:27.195777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:27.314260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:27.326791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7af6116d-1c41-4e4b-8409-cb455b6ccaa1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1271 microversion: 2.1 time: 0.156932 Sep 07 13:08:27.327655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 183/373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:27 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:27.356494 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:27.357182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:27.377491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:27.378269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:27.378921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:27.380220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:27.381011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:27.381748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:27.787382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:27.804957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-233009ed-ad0a-44e8-aa82-346d506b1900 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.455098 Sep 07 13:08:27.806271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 191/374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:27 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:28.115215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:28.116450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:28.126795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.128494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.128494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.129539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.130461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.131220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.145084 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:28.146203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:28.158025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.158954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.160066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.164187 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.165086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.165921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.229177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.230018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.230740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.231638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:28.304926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:28.319237 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bdc6f9ed-b301-472b-a426-cf5f4ff532b9 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.181344 Sep 07 13:08:28.320397 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 192/375] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:28 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:28.364543 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:28.368000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:28.369184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:28.374214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c116b831-7049-4e70-a2cf-9f0af1c2df62 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.266392 Sep 07 13:08:28.374926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 184/376] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:28 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:28.381368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.382139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.383948 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.384333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.385262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.386022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.624853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:28.640066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e316e09b-7704-44f3-87a1-3205ef35fb2f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.279129 Sep 07 13:08:28.641079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 193/377] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:28 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:28.842283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:28.843312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:28.860129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.860991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.861822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.863495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:28.864367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:28.865198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:28.908239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:29.120757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:29.131690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-801ed185-8ff5-459f-abc7-020a38f25c84 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.295979 Sep 07 13:08:29.132385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 185/378] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:28 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:29.364162 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:29.365229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:29.374468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.375164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.375856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.377132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.377935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.378611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.405349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:29.406639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:29.418324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.419848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.420671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.421973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.422816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.423576 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.443276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.443780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.444206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.444662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:29.505332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:29.523675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ac3e9a98-d3a1-4707-b394-9b6258afc0a4 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.167825 Sep 07 13:08:29.524764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 194/379] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:29 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:29.685250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:29.686773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:29.698743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.699607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.700367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.700668 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:29.701711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:29.702520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:29.703221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:29.715791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ae3a3baf-d124-43db-ad24-b73d4889d489 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.314730 Sep 07 13:08:29.716896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 186/380] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:29 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:29.934697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:29.945265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dbe4a104-9449-42c3-96f0-53d9250b0738 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.267921 Sep 07 13:08:29.945905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 195/381] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:29 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:30.169267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.170196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:30.183496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.184030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.184445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.185177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.185646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.186123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.427170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:30.442481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05b80db1-562a-42f0-b4c3-9f778bcd7d51 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.277424 Sep 07 13:08:30.443566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 187/382] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:30.563972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.564917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:30.575206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.575868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.576459 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.577624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.578451 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.579179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.634882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.635631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.636366 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.637142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:30.642254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:30.703597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:30.714239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-56505fcf-b15e-43b8-a25e-daeed7025f96 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.157022 Sep 07 13:08:30.714898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 196/383] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:30.756897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.757986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:30.764796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.765301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.765890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.766934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.767743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.768326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.951260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:30.965744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f1f266f1-dc9d-4e58-8fc6-d95b10682a8c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.214512 Sep 07 13:08:30.965744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 188/384] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:30.976466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.977791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:30.990784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.991900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.992527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.993905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.994767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.995440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.174270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:31.183263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-64908e2b-70e6-4caa-80b8-b3a206b0d622 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.215460 Sep 07 13:08:31.183855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 197/385] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:31.485481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:31.486408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:31.493832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.494337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.494789 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.495552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.496023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.496450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.667675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:31.678034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b78695a-c78b-459e-aad1-051a26b70ae8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.196559 Sep 07 13:08:31.678808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 189/386] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:31.744574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:31.745695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:31.756901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.757829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.758599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.760011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.760900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.761832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.807393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.807977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.808684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.809284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:31.877018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:31.887800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-06c5921c-1827-40df-a763-1e2c2d3ef689 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.151464 Sep 07 13:08:31.888543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 198/387] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:32.008080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:32.009209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:32.021405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.022162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.023599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.024606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.025408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.026140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.211460 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:32.212499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:32.222116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.222846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.223727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.225047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.225863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.226515 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.228589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:32.238882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-abd59dae-ab54-4af2-94e9-e19fab19e4b1 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.238255 Sep 07 13:08:32.239549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 190/388] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:32.459843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:32.470134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-faf11f92-6048-4658-88b3-af4c626accea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.264240 Sep 07 13:08:32.470841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 199/389] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:32 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:32.719152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:32.720065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:32.730990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.731398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.731856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.732629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.733066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.733486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.919701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:32.921012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:32.926910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:32.935409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.937468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.938404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.939831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:32.940780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:32.941590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:32.980720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:32.998309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e400c5b9-a197-49fe-ac2f-c74cd60affd3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1522 microversion: 2.1 time: 0.285290 Sep 07 13:08:32.999670 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 191/390] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:32 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:33.009763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:33.010758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:33.011655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:33.012543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:33.101544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:33.118309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-745c916c-26dd-48ec-b37d-5f8c9f24a85b tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.206324 Sep 07 13:08:33.119349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 200/391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:32 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:33.278201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:33.279369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:33.290510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:33.291385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:33.292169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:33.293537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:33.294358 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:33.295371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:33.498089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:33.498727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:33.505554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:33.510287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:33.511790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:33.512601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:33.514040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:33.515443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:33.516842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:33.517596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa92440c-aeef-460c-b868-6d267fb1ab89 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1315 microversion: 2.1 time: 0.245939 Sep 07 13:08:33.530774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 192/392] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:33 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:33.833106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:33.842599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9daaee0c-08f6-4fa5-8a1c-b87d73613e54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.349233 Sep 07 13:08:33.843203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 201/393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:33 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:34.014809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9", "tag": "af1aaae6-086f-416c-85ad-42281096b98d"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:34.027498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.027975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.028726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.044782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] Creating event network-changed:af1aaae6-086f-416c-85ad-42281096b98d for instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 on hv-cinder-85331 Sep 07 13:08:34.045140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.046239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.050485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-d86fb292-c8b0-4ebe-a0bf-f9909c5d9637 req-3d12bfa5-dc8d-4548-a0c7-1f21511ee729 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Sep 07 13:08:34.051353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 193/394] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:34.058749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.059595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.060342 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.061626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.062429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.063167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.154649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.155750 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.170132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.171141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.171879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.173655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.174816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.175537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.238437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.240581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.241318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.242178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:34.243860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:34.257325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-644011b5-9211-4d57-a19c-d209e5c99719 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1502 microversion: 2.1 time: 0.218823 Sep 07 13:08:34.258324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 202/395] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:34 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:34.282534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.283167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.290135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.290847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.291446 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.292565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.293202 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.293811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.304278 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:34.314454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d94f3b64-e4dd-4d38-91cf-8491a6302bad tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.165921 Sep 07 13:08:34.315053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 194/396] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:34 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:34.548807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.550516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.561561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.563018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.563466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.564298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.564770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.565195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.676352 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:34.685738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-21b60c4a-e544-4788-9e31-8c2cc7d0f93c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1515 microversion: 2.1 time: 0.406986 Sep 07 13:08:34.686668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 203/397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:34 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1515 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:34.791334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:34.801704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82e3b9d2-d225-46e7-bc56-e60069d06950 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1463 microversion: 2.1 time: 0.259277 Sep 07 13:08:34.802777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 195/398] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:34 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:34.871276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.872337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.884424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.885208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.885939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.886898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.887555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.887716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:34.888216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:34.888541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.896124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.898088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.898607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.899363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:34.899832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:34.900426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:34.940915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:08:35.119658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:35.134623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e45a7cc0-ade0-4a95-8bbf-cc16b8737a61 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.268415 Sep 07 13:08:35.153125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 204/399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:34 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:35.167549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cddbaff5-5255-440b-9614-2656d22d0c02 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 204 len: 0 microversion: 2.1 time: 0.282609 Sep 07 13:08:35.170088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 196/400] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:08:34 2022] DELETE /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:08:35.190482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:35.191152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:35.198779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:35.199282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:35.199729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:35.201186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:35.201969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:35.202609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:35.340181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:35.341921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:35.349188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:35.349696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:35.350338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:35.351236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:35.351780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:35.352214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:35.395415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:35.396004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:35.396505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:35.396968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:35.451107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:35.462183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5b211cad-f1be-4734-87bc-5a71134b479c tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.126702 Sep 07 13:08:35.462784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 197/401] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:35 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:35.683236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:35.696682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4074be71-e5bc-4bbf-8292-796b6fa78250 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1469 microversion: 2.1 time: 0.520930 Sep 07 13:08:35.697544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 205/402] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:35 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:36.173283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:36.174470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:36.186080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.186633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.187140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.188161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.188650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.189111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.393197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:36.404352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-286734fa-acd6-4f45-93d8-d2481b9aadcf tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.238793 Sep 07 13:08:36.419564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 198/403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:36 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:36.421618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:36.424543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:36.432326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.432870 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.433406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.434238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.434739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.435203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.463735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'flavor' on Instance uuid ec6ea81b-c4bc-4032-a3d9-db69e5369416 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:36.486737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:36.487435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:36.490549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:36.501087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.502115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.503080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.503979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.504537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.505058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.544440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.545099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.545730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.546182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:36.550779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cd94c29a-1f1c-4884-8e55-2a42fa4698a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/action" status: 200 len: 32 microversion: 2.1 time: 0.137006 Sep 07 13:08:36.556846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 206/404] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:08:36 2022] POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:08:36.567111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:36.568585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:36.578716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.579209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.579647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.580370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.580824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.581245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.601797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:36.617466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4ad2d5a1-592f-4738-975e-579f7eb31e7e tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.134685 Sep 07 13:08:36.618636 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 199/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:36 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:36.744393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:36.745412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:36.757988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.758892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.759652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.760910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:36.761727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:36.762484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:36.764582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:36.771136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:36.774069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-39253947-9ca0-4c71-8e1a-e785302df50c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.214614 Sep 07 13:08:36.774841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 207/406] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:36 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:36.964631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:36.974506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb591497-bb5f-46da-9b93-7242df80b60c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1469 microversion: 2.1 time: 0.237581 Sep 07 13:08:36.975113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 200/407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:36 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:37.434917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:37.435575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:37.445315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.446149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.446856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.448051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.448810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.449510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.652700 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:37.654166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:37.667733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:37.678211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e75a94ac-14b3-4d92-bb74-747526d78d58 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.250005 Sep 07 13:08:37.678617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 208/408] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:37 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:37.690044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.690664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.691095 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.692775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.693497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.694227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.735193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.735682 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.736120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.736571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lazy-loading 'fault' on Instance uuid a2a43fa6-feee-46eb-8439-0ab5e631ab83 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:37.789890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0db39216fd24b5f9cb0531bcedb0326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a847ae68ca242c0bce510fd91c2633c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:37.799966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b797d25-8cbe-40a3-969a-a0bc978922b2 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 200 len: 1351 microversion: 2.1 time: 0.151070 Sep 07 13:08:37.801279 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 201/409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:37 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:37.804235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:37.804964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:37.815475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.817102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.818457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:37.820676 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:37.822059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:37.824184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.015466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:38.016609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:38.029106 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.029938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.030595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.031548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.032437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.033215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.248570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:38.258716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:38.267022 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-26bb93a9-60c7-4328-a281-050ad5241cf4 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1469 microversion: 2.1 time: 0.257390 Sep 07 13:08:38.267899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 202/410] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:38 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:38.286359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-81757c11-8610-4815-b9c5-f22fb2bf6a73 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.488822 Sep 07 13:08:38.286359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 209/411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:37 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:38.720495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:38.721552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:38.733096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.734093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.734858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.736137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.736931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.737661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.830337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:38.831095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:38.848437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.852903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.853725 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.856718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:38.857897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:38.859351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:38.919618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] HTTP exception thrown: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Request method failure captured: Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 HTTP/1.1 Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdJuA_UKvYjKqdWr8NK4O9ij_LRcstjvFoGX0V_QXvneARs09zq2ml4PwQreCwtWxMSWxRqHnSj3k6xELzIE8R_jjStUtROeJamAx4-maqLUT7Ml8a8wbjDiDpQK7L4svCjqOY1NMXNrhDn2UspkLB0sUfzpR0oxyxJywTs7ZLOZQg Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:08:38.933185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a847ae68ca242c0bce510fd91c2633c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: c0db39216fd24b5f9cb0531bcedb0326 Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:38.935999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'a2a43fa6-feee-46eb-8439-0ab5e631ab83'} Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:38.937620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:38.940199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:38.946129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Returning 404 to user: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:38.947422 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-df16bf61-bd93-4407-856c-5d2ed48ffab5 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 404 len: 111 microversion: 2.1 time: 0.122495 Sep 07 13:08:38.948098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:38.949438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 210/412] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:38 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:08:38.964891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1da82ce1-2676-44cd-8517-92fc256b1b68 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.251669 Sep 07 13:08:38.965433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 203/413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:38 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:39.172281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:39.174734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:39.182843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.183503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.183949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.184873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.185531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.186332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.189884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:39.228745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] HTTP exception thrown: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Request method failure captured: Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83/os-volume_attachments HTTP/1.1 Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdJuA_UKvYjKqdWr8NK4O9ij_LRcstjvFoGX0V_QXvneARs09zq2ml4PwQreCwtWxMSWxRqHnSj3k6xELzIE8R_jjStUtROeJamAx4-maqLUT7Ml8a8wbjDiDpQK7L4svCjqOY1NMXNrhDn2UspkLB0sUfzpR0oxyxJywTs7ZLOZQg Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:08:39.232055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a847ae68ca242c0bce510fd91c2633c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: c0db39216fd24b5f9cb0531bcedb0326 Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:39.233423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'server_id': 'a2a43fa6-feee-46eb-8439-0ab5e631ab83'} Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:39.234170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:39.235391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:39.240948 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Returning 404 to user: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:39.244652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa32068f-a023-47bc-9d43-cbd39ce2107a tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.076405 Sep 07 13:08:39.250227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 211/414] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:08:39 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:08:39.292861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:39.293516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:39.310987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.312583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.313274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.315155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.316381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.317040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.331627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:39.334127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:39.359282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.365540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.366846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.368860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:39.371787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:39.373261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:39.620397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:39.637191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-40861d25-579f-44fd-8a36-ec2c7a25afc6 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1469 microversion: 2.1 time: 0.347877 Sep 07 13:08:39.638414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 204/415] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:39 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:39.858137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:39.866489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-32191ed4-fafd-4c23-ac52-9a24b23eb9cf tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.541729 Sep 07 13:08:39.878032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 212/416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:39 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:39.990531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:39.992269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:40.000955 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.002163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.003192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.004642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.005741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.006317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.201790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:40.214341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-35560fe2-6655-41ae-ad13-758fe3275871 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.228516 Sep 07 13:08:40.227167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 205/417] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:39 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:40.437656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91c9404-a193-46e3-b8f2-5164728ce0be", "name": "network-vif-deleted", "tag": "6d7f4a81-be9b-42fd-b7f3-e8541714e710"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:40.468149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.469433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.471068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.508928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] Creating event network-vif-deleted:6d7f4a81-be9b-42fd-b7f3-e8541714e710 for instance c91c9404-a193-46e3-b8f2-5164728ce0be on hv-cinder-85331 Sep 07 13:08:40.518931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-d383a907-e8b2-4aee-a766-6ce7cf36c7a4 req-6d73997d-a07c-4f50-84d5-c373acdd720b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091441 Sep 07 13:08:40.519660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 213/418] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:40.667472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:40.668506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:40.680430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.681290 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.682061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.683422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.684201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.684911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.731390 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.732228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.733559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.734523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lazy-loading 'fault' on Instance uuid c91c9404-a193-46e3-b8f2-5164728ce0be {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:40.757296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:40.759255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:40.771804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.772317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.773011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.774396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.775371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.776437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.797963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:40.805503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] HTTP exception thrown: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.808608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3c4ef539-6c59-4807-a903-1f0047381a76 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1305 microversion: 2.1 time: 0.148740 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Request method failure captured: Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 HTTP/1.1 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdJuA_UKvYjKqdWr8NK4O9ij_LRcstjvFoGX0V_QXvneARs09zq2ml4PwQreCwtWxMSWxRqHnSj3k6xELzIE8R_jjStUtROeJamAx4-maqLUT7Ml8a8wbjDiDpQK7L4svCjqOY1NMXNrhDn2UspkLB0sUfzpR0oxyxJywTs7ZLOZQg Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:08:40.809791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a847ae68ca242c0bce510fd91c2633c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: c0db39216fd24b5f9cb0531bcedb0326 Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.813050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'a2a43fa6-feee-46eb-8439-0ab5e631ab83'} Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:40.814955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.817475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.819911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 206/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:40 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:40.821706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Returning 404 to user: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:40.823133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-afa2eefb-efcd-4079-af33-35c8fd2447de tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 404 len: 111 microversion: 2.1 time: 0.071864 Sep 07 13:08:40.824117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:08:40 2022] DELETE /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:08:40.836080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:40.836705 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] [instance: a2a43fa6-feee-46eb-8439-0ab5e631ab83] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:40.843433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.843971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.844411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.845141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.845605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.846062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.862222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] HTTP exception thrown: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Request method failure captured: Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 HTTP/1.1 Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdJuA_UKvYjKqdWr8NK4O9ij_LRcstjvFoGX0V_QXvneARs09zq2ml4PwQreCwtWxMSWxRqHnSj3k6xELzIE8R_jjStUtROeJamAx4-maqLUT7Ml8a8wbjDiDpQK7L4svCjqOY1NMXNrhDn2UspkLB0sUfzpR0oxyxJywTs7ZLOZQg Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:08:40.868101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a847ae68ca242c0bce510fd91c2633c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a847ae68ca242c0bce510fd91c2633c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 9a847ae68ca242c0bce510fd91c2633c Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-DeleteServersTestJSON-863103434 Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: c0db39216fd24b5f9cb0531bcedb0326 Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-DeleteServersTestJSON-863103434-project Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.870608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a2a43fa6-feee-46eb-8439-0ab5e631ab83'} Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:40.871942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. Sep 07 13:08:40.874064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:40.875901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] Returning 404 to user: Instance a2a43fa6-feee-46eb-8439-0ab5e631ab83 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:40.875901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-99eef1da-aa40-4276-a52e-7e3eeadd4672 tempest-DeleteServersTestJSON-863103434 tempest-DeleteServersTestJSON-863103434-project] 10.222.0.17 "GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83" status: 404 len: 111 microversion: 2.1 time: 0.038840 Sep 07 13:08:40.875901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 207/421] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:40 2022] GET /compute/v2.1/servers/a2a43fa6-feee-46eb-8439-0ab5e631ab83 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:40.896067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:40.898638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:40.913329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.914403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.915301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:40.916856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:40.917913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:40.918755 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.156604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:41.174532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-01b96545-b837-4f8c-a6f3-35a6ed44bf01 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.286037 Sep 07 13:08:41.175649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 215/422] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:40 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:41.243661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:41.244832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:41.256515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:41.257480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:41.258157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.259406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:41.260135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:41.261096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.566120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:41.585355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ac82da24-52bc-4a6b-b024-4266395f350c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.348153 Sep 07 13:08:41.588141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 208/423] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:41 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:41.848375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:41.849906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:41.860536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:41.861843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:41.862633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.864224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:41.865508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:41.865889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.931955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:41.931955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:41.931955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:41.931955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lazy-loading 'fault' on Instance uuid c91c9404-a193-46e3-b8f2-5164728ce0be {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:42.035117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:42.050038 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-abfedd8c-9e10-4673-8965-a9a7f485ee9c tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1305 microversion: 2.1 time: 0.208068 Sep 07 13:08:42.051566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 216/424] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:41 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1305 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:42.210680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:42.211874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:42.231343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:42.239481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:42.240304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:42.241089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:42.241571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:42.242026 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:42.623507 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:42.624548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:42.635338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:42.636178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:42.637246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:42.639189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:42.640016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:42.640766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:42.687377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:42.714775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aaece7c8-910c-489e-b084-8a9f286ea1ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.511909 Sep 07 13:08:42.734424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 209/425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:42 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:42.879866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:42.909573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-92afbaee-027e-4687-895a-4a4014e8ee50 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.295480 Sep 07 13:08:42.911284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 217/426] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:42 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:43.101259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:43.102157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:43.111208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.112560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.113577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.115729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.116562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.117398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.173580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.173580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.175007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.175319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lazy-loading 'fault' on Instance uuid c91c9404-a193-46e3-b8f2-5164728ce0be {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:43.281367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:43.299022 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-313ca46f-f61c-45be-b4f3-ca7ac55b2e52 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1305 microversion: 2.1 time: 0.205030 Sep 07 13:08:43.299843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 210/427] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:43 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1305 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:43.765412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:43.766543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:43.795506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.796457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.797216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.801617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.802538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.806523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.950621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:43.957525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:43.985380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.985929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.986391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.987487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.987959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.990581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.294484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:44.317520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ab13e67a-e9c0-4bef-9cdc-baa3de339f7f tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.380468 Sep 07 13:08:44.335141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 211/428] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:43 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:44.360740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:44.362140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:44.373539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:44.374908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:44.375894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.377393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:44.378710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:44.379820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.399174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:44.413616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-31e9c096-b5a3-4ba7-8339-65459bce505f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.657343 Sep 07 13:08:44.417424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 218/429] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:43 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:44.443506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:44.444749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:44.445414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.446279 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lazy-loading 'fault' on Instance uuid c91c9404-a193-46e3-b8f2-5164728ce0be {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:08:44.553714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c589c9ed14594c498eb5a2af90030231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2e1474e0024ac3918f295c3e228869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:44.569885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f0601a3-2184-458a-8eb2-417bcd630b16 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 200 len: 1305 microversion: 2.1 time: 0.220098 Sep 07 13:08:44.570972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 212/430] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:44 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 1305 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:45.362636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:45.363258 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:45.371561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.372500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.373124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.374318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.375024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.375648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.449331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:45.450827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:45.464090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.465777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.466810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.467852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.468705 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.470267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.839345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:45.869640 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d41ad02e-8aa4-4db3-89ca-0f06ac27399e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.428829 Sep 07 13:08:45.884928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 213/431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:45 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:45.904757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:45.906013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] [instance: c91c9404-a193-46e3-b8f2-5164728ce0be] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:45.923374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.925353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.926524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.929396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:45.931110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:45.932210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:45.956134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:45.972579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] HTTP exception thrown: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Request method failure captured: Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be HTTP/1.1 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJeLmRibdTnS3321Mc3GVH_OORUhwLF6OnJAyHcJtnHmIcYqiK2JVhAhfHWl3EzcdatPfQclD9GHRHv6wuJnPQ0Fi2FwG_jBrJtJjs3874MfQUz-o8Q8rbCeJTIRXmx_Z85dOSUK53MlkJ-mEZ1sW9FIlFLW2nuqJZol8QPGinuRsso Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 1f2e1474e0024ac3918f295c3e228869 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesNegativeTest-1367626678 Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:08:45.975912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1f2e1474e0024ac3918f295c3e228869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1f2e1474e0024ac3918f295c3e228869", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1f2e1474e0024ac3918f295c3e228869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1f2e1474e0024ac3918f295c3e228869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesNegativeTest-1367626678 Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 1f2e1474e0024ac3918f295c3e228869 Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesNegativeTest-1367626678 Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesNegativeTest-1367626678-project Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: c589c9ed14594c498eb5a2af90030231 Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesNegativeTest-1367626678-project Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. Sep 07 13:08:45.978272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'c91c9404-a193-46e3-b8f2-5164728ce0be'} Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:45.979674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. Sep 07 13:08:45.982688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:08:45.988541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0b9b304d-cb99-42fe-8ffa-beada99141fb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.630143 Sep 07 13:08:45.989770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 219/432] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:45 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:45.990823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] Returning 404 to user: Instance c91c9404-a193-46e3-b8f2-5164728ce0be could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:45.992281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dc5f1ab6-5a38-4436-b507-bddf42422bf9 tempest-VolumesNegativeTest-1367626678 tempest-VolumesNegativeTest-1367626678-project] 10.222.0.17 "GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be" status: 404 len: 111 microversion: 2.1 time: 0.104566 Sep 07 13:08:45.994361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 214/433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:45 2022] GET /compute/v2.1/servers/c91c9404-a193-46e3-b8f2-5164728ce0be => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:46.922150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:46.922995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:46.934837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:46.937145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:46.938998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:46.941006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:46.942258 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:46.943560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:47.020179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:47.024113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:47.052692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:47.058967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:47.059717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:47.060937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:47.061741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:47.062470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:47.323041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:47.369864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a9a82065-cd83-4f80-846e-4d5ac2c0ff6e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.430156 Sep 07 13:08:47.371365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 220/434] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:46 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:47.556550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:47.571854 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7a8c21b7-7a59-48fe-8866-7038e63aaa54 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.558587 Sep 07 13:08:47.572965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 215/435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:47 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:48.415174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:48.416826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:48.425585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:48.426447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:48.428026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:48.429607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:48.430137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:48.431326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:48.600098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:48.601131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:48.608430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:48.609075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:48.609928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:48.610676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:48.611146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:48.611573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:48.682134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:48.694764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a25527c5-3d6a-4d4f-a310-f4f3081c2809 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.285602 Sep 07 13:08:48.695856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 221/436] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:48 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:48.862055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:48.871623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:48.887052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-96fb2eae-d04c-4082-8849-705473b50545 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.291203 Sep 07 13:08:48.890126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 216/437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:48 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:49.734647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:49.736849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:49.767893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:49.768931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:49.769784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:49.771454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:49.772197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:49.773033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:49.908523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9", "name": "network-vif-plugged", "status": "completed", "tag": "af1aaae6-086f-416c-85ad-42281096b98d"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:49.949252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:49.950502 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:49.951694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:49.981564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] Creating event network-vif-plugged:af1aaae6-086f-416c-85ad-42281096b98d for instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 on hv-cinder-85331 Sep 07 13:08:49.996501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-9da325d3-b058-48e3-abdf-53274e0f146c req-42d702a1-28f7-400f-8c0b-3118078ee291 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094374 Sep 07 13:08:49.999662 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 217/438] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:50.011004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:50.012890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:50.031415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:50.032909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:50.034080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:50.035675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:50.038180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:50.040761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:50.333646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:50.351627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-90b11349-0226-4786-bb04-8eb8087029e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.624003 Sep 07 13:08:50.368578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 222/439] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:49 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:50.555175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:50.577025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4c3b0011-d89e-424b-8152-2eaff148cbbb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.574423 Sep 07 13:08:50.590380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 218/440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:50 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:51.396975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.398336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:51.411257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:51.413353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:51.414587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:51.421606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:51.423044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:51.424592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:51.638388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:51.640733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:51.660947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:51.663086 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:51.664625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:51.666633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:51.670540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:51.671662 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:51.904717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:51.935160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fb110114-e887-4650-ab70-96ebe4689ac3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.545226 Sep 07 13:08:51.940481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 223/441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:51 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:52.626711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:52.651997 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d78e9909-997d-4c22-ab1d-1c932c84f0d9 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 1.020725 Sep 07 13:08:52.654116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 219/442] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:51 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:52.985765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:52.989001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:53.020441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:53.022002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:53.023056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:53.024756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:53.025886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:53.026861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:53.268939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:53.279658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-47adeb1b-b2ff-45ca-9193-e2c664f1cdc7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.310243 Sep 07 13:08:53.280619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 224/443] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:52 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:53.701656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:53.702458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:53.721901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:53.722448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:53.725777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:53.727106 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:53.727845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:53.728644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:54.201873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:54.224105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d29dddeb-a486-497f-9732-f8671339411b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1313 microversion: 2.1 time: 0.527347 Sep 07 13:08:54.225803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 220/444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:53 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:54.324898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:54.329531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:54.343303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:54.344162 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:54.344938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:54.349629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:54.350603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:54.351683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:54.660244 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:54.673396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-971b493a-bd1d-4c5d-8033-0edd98db0994 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.355879 Sep 07 13:08:54.675343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 225/445] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:54 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:55.270575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.272563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:55.284485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:55.287599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:55.290292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:55.291271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:55.295784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:55.296655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:55.723305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:55.726199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:55.754801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:55.755733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:55.757254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:55.758355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:55.759037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:55.759696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:56.049870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:56.086518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1a7c6943-9696-4ede-9a27-4c689072484a tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1496 microversion: 2.1 time: 0.820189 Sep 07 13:08:56.113811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 221/446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:55 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1496 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:56.208101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:56.220830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a9b92eec-a82e-43d1-afd5-82ce395ed42e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.505689 Sep 07 13:08:56.222180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 226/447] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:55 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:57.144846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:57.145599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:57.165953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.166449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.166922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.167913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.168434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.168854 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.227455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:08:57.265333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:57.280025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:57.293430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.294659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.295698 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.298793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.300134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.301289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.478428 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2a13af6-f58f-4523-8512-3766c12ea6fd tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 204 len: 0 microversion: 2.1 time: 0.338838 Sep 07 13:08:57.482089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 222/448] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:08:57 2022] DELETE /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:08:57.490034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:57.490034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:57.498682 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.499292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.499820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.500706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.501276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.501822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.672530 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:57.692054 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dfa307d0-7d5c-4c13-a2e7-7039a79d9d5a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1501 microversion: 2.1 time: 0.437621 Sep 07 13:08:57.694708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 227/449] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:57 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1501 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:57.717510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18e566f4-2d15-4b9b-8729-67c6efd9a8a9"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:57.720749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:57.736522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.738225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.739246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.741357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.743011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.743932 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.800382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] HTTP exception thrown: Cannot 'attach_volume' instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 while it is in vm_state rescued Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Request method failure captured: Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/os-volume_attachments HTTP/1.1 Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 74 Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdNYMn96FfG87ejrN3gZhTeySUroTnqKfMThkVCKaxgitJxut8GKAznk9hHfeRez9ivmWqQdH_2aioZNLNl5zDfcleKvIleAAgYNdM5_zqbmHl4DTW0pLKS6QEhjGzWSxuctpXSyaetu0e3jF1VX35lmS8mkZ3AvdYrthqnIH0gphY Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:08:57.804291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9bb55accaa9046d99253a42a3154fe1b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 3cad6d025da54eb29d09fd2a2888c844 Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {"volumeAttachment": {"volumeId": "18e566f4-2d15-4b9b-8729-67c6efd9a8a9"}} Sep 07 13:08:57.807133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Cannot 'attach_volume' instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 while it is in vm_state rescued Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'server_id': 'ec6ea81b-c4bc-4032-a3d9-db69e5369416', 'body': {'volumeAttachment': {'volumeId': '18e566f4-2d15-4b9b-8729-67c6efd9a8a9'}}} Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:08:57.808610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 while it is in vm_state rescued Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:08:57.811131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:08:57.813353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:08:57.813353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:08:57.813353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 while it is in vm_state rescued Sep 07 13:08:57.813353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:08:57.818393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Returning 409 to user: Cannot 'attach_volume' instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 while it is in vm_state rescued {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:08:57.818393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-669f6db3-533c-4a38-ae65-0a3c43bbc246 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104805 Sep 07 13:08:57.820172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 228/450] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:08:57 2022] POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/os-volume_attachments => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 13:08:57.834715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:57.836608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:57.850916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.853033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.854947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.856899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:57.858333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:57.859575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:57.930948 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:57.936301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:57.948017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dfb39ae0-d03f-4751-8fbd-d3e313221caa tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1502 microversion: 2.1 time: 0.462679 Sep 07 13:08:57.949131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 223/451] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:57 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:58.026812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9a09d364-3cf8-43e2-a4df-82c0af561c19 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/action" status: 202 len: 0 microversion: 2.1 time: 0.199998 Sep 07 13:08:58.031109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 229/452] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:08:57 2022] POST /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:08:58.038545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:58.039544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:58.060738 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:58.061545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:58.062196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:58.063810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:58.066481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:58.068012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:58.659918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:58.679054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-65e773a7-fdf2-4060-b752-d732474c69d3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1509 microversion: 2.1 time: 0.645223 Sep 07 13:08:58.695280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 224/453] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:58 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1509 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:58.974254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:58.975280 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:58.987805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:58.990797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:58.991865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:58.992959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:58.994567 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:58.995571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:59.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:59.333749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d64a52d3-61a0-4566-9703-880a08827202 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1502 microversion: 2.1 time: 0.364178 Sep 07 13:08:59.347205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 230/454] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:58 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:59.638551 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f8b6eee7-6c7b-4ba3-a1aa-12efcdb2b61c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: .version_select at 0x7fdc41fb4f70>, body: {"keypair": {"name": "tempest-keypair-631320152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA00TB3b8AmG1Goxtrq/efGNmf8vjnBlG8Olcp/hNvOPlndmbdBTfPvsp9A0pOSTRPGMiQVn2b/gLpm3sJ4pUIovZR4oBv4hFMMsIxMOqqZDsR1GocwfBFJiPpaUfqrgvw=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:59.713018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-f8b6eee7-6c7b-4ba3-a1aa-12efcdb2b61c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for project b33fcaf2f89d4438947508dee3737cee. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:08:59.727598 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-f8b6eee7-6c7b-4ba3-a1aa-12efcdb2b61c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for user 30153f2f99424f29afaf718784c9f6b1 and project b33fcaf2f89d4438947508dee3737cee. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:08:59.729108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:59.730383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:59.765391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:59.769239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:59.770227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:59.775768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:59.779255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:59.782771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:59.793008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f8b6eee7-6c7b-4ba3-a1aa-12efcdb2b61c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.413179 Sep 07 13:08:59.795293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 225/455] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:08:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:00.367986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:00.386862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:00.430996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:00.435044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:00.436268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:00.437689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:00.443638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:00.445096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:00.771947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:00.793941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-602f99f6-b09d-4af7-b94e-40fad56f489a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1509 microversion: 2.1 time: 1.075002 Sep 07 13:09:00.815267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 231/456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:59 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1509 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:01.112546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:01.134965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c0987920-cfa7-491a-b53d-4dce7c0ccbea tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1502 microversion: 2.1 time: 0.778922 Sep 07 13:09:01.138882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 226/457] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:00 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1502 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:01.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:01.844862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:01.858408 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:01.859304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:01.860097 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:01.861376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:01.862355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:01.863402 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:02.203315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:02.204108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:02.218303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:02.219357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:02.220259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:02.221609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:02.222670 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:02.223507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:02.464775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:02.482094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8305aa4f-8fd4-413a-93bd-05a98fb56772 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1509 microversion: 2.1 time: 0.649020 Sep 07 13:09:02.498458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 232/458] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:01 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1509 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:02.522150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9", "name": "network-vif-deleted", "tag": "af1aaae6-086f-416c-85ad-42281096b98d"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:02.544417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:02.546015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:02.547358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:02.573749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] Creating event network-vif-deleted:af1aaae6-086f-416c-85ad-42281096b98d for instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 on hv-cinder-85331 Sep 07 13:09:02.582079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-b140ffce-638f-4721-9ffc-e010b2decb73 req-4b125e64-1a77-4d11-a3e1-b6523518184e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081457 Sep 07 13:09:02.588073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 233/459] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:02.598524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-588037915", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "networks": [{"uuid": "3defdac7-549c-4f2b-9796-6cb90bc141ef"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:02.637464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:02.653698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82c64d23-c30b-4f94-80d2-282e78578299 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1460 microversion: 2.1 time: 0.469745 Sep 07 13:09:02.655609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 227/460] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:02 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1460 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:02.742125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] validate_networks() for [('3defdac7-549c-4f2b-9796-6cb90bc141ef', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:09:03.531527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:03.532275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:03.551268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:03.551884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:03.552417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:03.554633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:03.555981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:03.558185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:03.739269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:09:03.740426 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:09:03.740920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:09:03.743836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:09:03.743836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:09:03.745606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=74 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:03.801750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:03.807642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:03.810495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:03.816005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:03.824434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:03.827256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:03.895860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Getting quotas for project 73afbf716079452ba1deb906dbdce949. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:03.913632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Getting quotas for user b22dd3b0461747688993851ccf4e66d0 and project 73afbf716079452ba1deb906dbdce949. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:03.927205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:03.939620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-39d8700f-2f63-4299-b022-55b498d69bc2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1509 microversion: 2.1 time: 0.414057 Sep 07 13:09:03.954690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 228/461] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:03 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:03.977735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:09:03.982392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:03.983879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:03.985321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:09:04.018277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.019744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.020792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:04.035759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.036994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.039319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:04.095167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bafa9ade-44a4-4dde-8410-27aa5c4b21fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503705 Sep 07 13:09:04.095686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 234/462] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:09:04.108517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1749762449", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dd23664-b42a-4d80-9c90-aa63bd35ceac"}], "security_groups": [{"name": "tempest-securitygroup--1204031052"}], "key_name": "tempest-keypair-631320152", "user_data": "}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:04.229727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:04.247605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2bc091e-80f6-4b97-8541-bf42c90635e2 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1298 microversion: 2.1 time: 0.289599 Sep 07 13:09:04.258253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 229/463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:03 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1298 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:04.290928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-19bee659-12d9-4875-9bc1-20b3aa74bbdb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:04.292433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-19bee659-12d9-4875-9bc1-20b3aa74bbdb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:04.368849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] validate_networks() for [('4dd23664-b42a-4d80-9c90-aa63bd35ceac', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:09:04.428710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-19bee659-12d9-4875-9bc1-20b3aa74bbdb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:04.462770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-19bee659-12d9-4875-9bc1-20b3aa74bbdb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1218 microversion: 2.1 time: 0.181584 Sep 07 13:09:04.472473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 230/464] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:04 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:04.975698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:04.976742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:04.987792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.988368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.988901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:04.989791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.990372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.991144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.337883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:05.352517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f484ff4-7c9a-41b1-847e-5424e8887f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1515 microversion: 2.1 time: 0.383374 Sep 07 13:09:05.357210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 231/465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:04 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:05.367741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:05.369378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:05.389037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.389811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.390441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.391603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.392312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.395223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.447274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.447778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.448275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.448905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lazy-loading 'fault' on Instance uuid ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:09:05.474006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:09:05.474006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:09:05.474848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:09:05.475998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:09:05.477329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:09:05.511367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.512147 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.512819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.514112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.514816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.515810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.618091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for project b33fcaf2f89d4438947508dee3737cee. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:05.622429 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:05.625868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for user 30153f2f99424f29afaf718784c9f6b1 and project b33fcaf2f89d4438947508dee3737cee. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:05.655858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-02e15552-a5f0-4278-b818-72a3ca3c1029 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 200 len: 1303 microversion: 2.1 time: 0.297317 Sep 07 13:09:05.657741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 232/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:05 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:05.658195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:09:05.669753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:09:05.674508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:05.675799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:05.705800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.707051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.708045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.710670 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:05.711587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:05.712250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:05.849178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-054ff17a-25a2-4637-8935-e58e1dbb3048 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.750214 Sep 07 13:09:05.856084 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 235/467] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:09:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:09:05.872957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-780496ce-8ef2-4035-bf4b-c910cc1ae98b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:05.873899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-780496ce-8ef2-4035-bf4b-c910cc1ae98b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:05.917421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:05.930703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-40ec874b-0e93-4cc6-8234-09d32c1a34bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1214 microversion: 2.1 time: 0.270784 Sep 07 13:09:05.934952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 233/468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:05 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:05.996647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-780496ce-8ef2-4035-bf4b-c910cc1ae98b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:06.006061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-780496ce-8ef2-4035-bf4b-c910cc1ae98b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1237 microversion: 2.1 time: 0.141342 Sep 07 13:09:06.011472 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 236/469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:05 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:06.703041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:06.704800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:06.707948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:06.726284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:06.727179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:06.727872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:06.729008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:06.729845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:06.730494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:06.736482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:06.757353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] HTTP exception thrown: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Request method failure captured: Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 HTTP/1.1 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJeqpK-0VoaqhHD0rIyHoyNbqnoiof73YpQ4YVbb_4xBWLjWrVm6s7tSGcVgFmWBrsIFjr3AoE5o0-PO3_xuKlQUhRIgdS6eGBQ2K9cCV9bzT79DJeqSU3JsuRTkCIwmjsOQkX_5ZFJSjdknM3RwAUgzHxaI9avYuRDiTx3ql4zEy2w Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 4da3acfcc34b44a5909e036705c040c8 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:09:06.759412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4da3acfcc34b44a5909e036705c040c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 4da3acfcc34b44a5909e036705c040c8 Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesActionsTest-1552885283-project Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 86032a9fd3b8429b99a7d23ddaf03116 Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesActionsTest-1552885283-project Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. Sep 07 13:09:06.760762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9'} Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:09:06.761646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. Sep 07 13:09:06.763412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:09:06.765055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Returning 404 to user: Instance ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:09:06.765055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7a8b9f2c-799b-4060-84bb-3ab8e429f08c tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9" status: 404 len: 111 microversion: 2.1 time: 0.064651 Sep 07 13:09:06.769875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 234/470] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:06 2022] GET /compute/v2.1/servers/ff6a8e9d-8cc0-4569-a5ca-9542a17b13f9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:09:06.907558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-515759507", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "networks": [{"uuid": "546b12c3-eadf-45e8-b433-886beccf35ac"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:06.984331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:06.988556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:07.024531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.038354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.039405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.042051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.043163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.044160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.048088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] validate_networks() for [('546b12c3-eadf-45e8-b433-886beccf35ac', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:09:07.164831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:07.176307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-67738d95-af4b-4278-a756-efd71ed8f35b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1278 microversion: 2.1 time: 0.205922 Sep 07 13:09:07.179021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 235/471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:06 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:07.194218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:07.194935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:07.205104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.210478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.212029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.213368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.214043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.215090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.305557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:07.319139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d781e1d5-c9f1-4cca-9fac-fa344b9b2479 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1233 microversion: 2.1 time: 0.138300 Sep 07 13:09:07.319818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 236/472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:07 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1233 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:08.204727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:08.206203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:08.215344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.215854 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.216296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.217024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.217480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.217946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.262167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:09:08.263006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:09:08.264385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:09:08.265243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:09:08.266146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:09:08.293576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.294721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.298952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.304837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.304837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.305855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.344983 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:08.348296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Getting quotas for project 4da3acfcc34b44a5909e036705c040c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:08.355960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Getting quotas for user 86032a9fd3b8429b99a7d23ddaf03116 and project 4da3acfcc34b44a5909e036705c040c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:08.361881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-886d4bbc-dc3b-41ec-b780-c3bec8c8da9c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1276 microversion: 2.1 time: 0.161032 Sep 07 13:09:08.362434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 237/473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:08 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:08.389211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:08.390687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:08.421785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.422639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.423392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.424669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:08.427305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:09:08.432682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:09:08.434148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:08.438971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:08.574941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-07a9b470-572a-4635-a576-54563eea5108 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673497 Sep 07 13:09:08.576959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 237/474] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:09:08.587483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0aad4ca7-2bc9-4ac6-bec6-6f0a03c8b7fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: .version_select at 0x7fdc421d79d0>, body: {"keypair": {"name": "tempest-keypair-2094163060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH26B+3uapL/ZV3sb1re9yMcYDauSxU7K65Xkgeg/xBg1cSIb5NfGc88qZ64HTyMMyRfRlNxP0t4c39UMHpElxdGGJSwOyKx9kSEFQQJGzCpl/e24jE/tGYfpOwOpG8KCg=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:08.604517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:08.622243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fece84aa-270d-440f-8476-100ad55432ff tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1307 microversion: 2.1 time: 0.257646 Sep 07 13:09:08.625546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 238/475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:08 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:08.627822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-0aad4ca7-2bc9-4ac6-bec6-6f0a03c8b7fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:08.634636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-0aad4ca7-2bc9-4ac6-bec6-6f0a03c8b7fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for user 3cad6d025da54eb29d09fd2a2888c844 and project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:08.650971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7131dc74-aa3b-40cf-8032-cbf5168807e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:08.652151 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7131dc74-aa3b-40cf-8032-cbf5168807e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:08.707858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0aad4ca7-2bc9-4ac6-bec6-6f0a03c8b7fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128454 Sep 07 13:09:08.713530 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 238/476] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:09:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:08.785369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7131dc74-aa3b-40cf-8032-cbf5168807e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:08.809584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7131dc74-aa3b-40cf-8032-cbf5168807e7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1213 microversion: 2.1 time: 0.181499 Sep 07 13:09:08.812335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 239/477] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:08 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:09.418679 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:09.421053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:09.433689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.435015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.435856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.437474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.438677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.439787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.655549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:09.657167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:09.671927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.672766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.674009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.675979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.677230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.678524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.851582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:09.883575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6b446a7c-9ba7-4b27-ae16-00679868c540 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1295 microversion: 2.1 time: 0.235784 Sep 07 13:09:09.886466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 240/478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:09 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:09.904217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:09.905662 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:09.919610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.923157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.924410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.926004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.928300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.929032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:10.037687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:10.059385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a55ec2f8-bfc3-464e-acf4-b96e1667dfcc tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1209 microversion: 2.1 time: 0.168458 Sep 07 13:09:10.062419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 241/479] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:09 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1209 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:10.172918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:10.195412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0d5ac6d1-9a10-427b-b059-ec2a3671093d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.786581 Sep 07 13:09:10.197502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 239/480] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:09 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:10.930757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:10.931919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:10.961723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:10.963025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:10.964057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:10.965547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:10.966879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:10.968150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.111427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:11.121704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:11.159180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.160450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.165865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.169728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.170881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.175145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.576366 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:11.581205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:11.597346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a065fc4a-cf9a-4b3e-8c55-4a00c917a3f3 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1273 microversion: 2.1 time: 0.494920 Sep 07 13:09:11.602855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 240/481] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:11 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:11.624371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:11.625629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:11.634282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bdd81792-b110-4bba-badc-05383a718552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.712661 Sep 07 13:09:11.647592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.648700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.649858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.654432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.655164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.655888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.658636 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 242/482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:10 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:12.353091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:12.377218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ee58bc5c-762f-415e-8a4a-97e814441d94 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.770602 Sep 07 13:09:12.378921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 241/483] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:11 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:12.607185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd694b4-270a-4501-ba55-c9989f249ba3", "tag": "9cecf480-11f3-48d5-87f6-6f2db6a159cb"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:12.622669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.623465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.624731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.640516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] Creating event network-changed:9cecf480-11f3-48d5-87f6-6f2db6a159cb for instance 0fd694b4-270a-4501-ba55-c9989f249ba3 on hv-cinder-85331 Sep 07 13:09:12.641939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:12.644127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:12.649600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-da858b3f-900f-494f-ac8e-1e5429e89286 req-4cc79ab8-d12e-4540-b343-149ef8f574e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054179 Sep 07 13:09:12.653383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 243/484] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:12.692785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.697325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.698918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.701122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.702432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.703562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.705994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:12.709292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:12.732373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.734791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.735430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.737273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.737981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.738577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.935012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:12.955079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7cc9de7e-8b7d-4911-b543-3fded4946673 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1271 microversion: 2.1 time: 0.328510 Sep 07 13:09:12.966954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 242/485] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:12 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1271 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:13.011665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1036658087", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "265b63b5-382d-4472-bef8-7754cbffccf7"}], "security_groups": [{"name": "tempest-securitygroup--846034804"}], "key_name": "tempest-keypair-2094163060", "user_data": "}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:13.066194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:13.087293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9dcadfbf-9c0c-4277-a4c1-ea6ba1afd17e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.396482 Sep 07 13:09:13.104459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 244/486] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:12 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:13.426899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:13.427774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:13.440867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:13.441160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] validate_networks() for [('265b63b5-382d-4472-bef8-7754cbffccf7', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:09:13.443142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:13.445316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:13.447167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:13.448570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:13.449774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:13.713860 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:13.723755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0a7c2e90-3454-4e68-9e2f-047636a84df3 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.302994 Sep 07 13:09:13.724716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 245/487] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:13 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:13.992880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:14.001342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:14.041479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.049469 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.050263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.051663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.052272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.053478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.231548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:14.244680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2c8e37a1-a568-44aa-8cc5-77dff27bf327 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1271 microversion: 2.1 time: 0.259993 Sep 07 13:09:14.245284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 246/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:13 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:14.250260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:14.250861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:14.259438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.260001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.260455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.261204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.261699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.262110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.503003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:14.520296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1fafe458-2bc1-43b3-90ad-94b93226429d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.273210 Sep 07 13:09:14.549833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 247/489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:14 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:14.765516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:14.766625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:14.774910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.775719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.776147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.776862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.777580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.778248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.963482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:14.975974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fc461658-3bb5-4ad9-bed2-dece0d435a7e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.217376 Sep 07 13:09:14.976700 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 248/490] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:14 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:14.981954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08cc93d9-9e4f-4c6a-adda-4f3f34ac099b", "tag": "555b5068-66f6-4c6e-b495-1103b4954fa4"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:14.994407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:14.994983 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:14.995867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.009980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] Creating event network-changed:555b5068-66f6-4c6e-b495-1103b4954fa4 for instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b on hv-cinder-85331 Sep 07 13:09:15.015780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-7a7501c8-cbfb-4ca7-9326-3f7515419668 req-e4baa34e-2b23-46d6-9bc7-55c975511b88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037477 Sep 07 13:09:15.016414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 249/491] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:15.282105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:15.283183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:15.291079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.291576 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.292018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.292739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.293216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.294440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.394388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:09:15.395475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:09:15.396449 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:09:15.398686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:09:15.399811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:09:15.421899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.424420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.425930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.428499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.429903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.431380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.500234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:15.522312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Getting quotas for user 3cad6d025da54eb29d09fd2a2888c844 and project 9bb55accaa9046d99253a42a3154fe1b. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:15.540711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:09:15.551502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:09:15.616843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:15.653790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0fe1d52c-ce35-4437-af90-0159b9561075 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.365729 Sep 07 13:09:15.659526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-18fc8024-232c-4ef9-a443-25bf1c5d7017 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.664704 Sep 07 13:09:15.660856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 243/492] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:09:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:09:15.668135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 250/493] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:15 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:15.676291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4b53566a-9729-4afb-8922-430c18e89bb3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:15.677290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4b53566a-9729-4afb-8922-430c18e89bb3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:15.691781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:15.692816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:15.705440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.706368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.707146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.711422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.716645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.717581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.957156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4b53566a-9729-4afb-8922-430c18e89bb3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:15.972229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4b53566a-9729-4afb-8922-430c18e89bb3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1246 microversion: 2.1 time: 0.301387 Sep 07 13:09:15.972842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 244/494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:15 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1246 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:16.011443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:16.014469 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:16.018172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:16.034740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b887e754-6f48-4b7a-ae41-8019848ab322 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.365779 Sep 07 13:09:16.036978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 251/495] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:15 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:16.038399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:16.039179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:16.039687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:16.040429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:16.045653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:16.046133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:16.342131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:16.355306 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-072cc425-5d54-43eb-933b-98d54bf96d92 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.353988 Sep 07 13:09:16.356347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 245/496] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:15 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:16.696641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:16.697521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:16.708466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:16.710140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:16.711135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:16.712471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:16.713305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:16.714085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:16.948909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:16.963712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ecad97df-02c1-4a10-9e6a-c0ee99691b66 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.273932 Sep 07 13:09:16.964755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 252/497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:16 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:17.003923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:17.005157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:17.014053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.015047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.015804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.016829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.017307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.017792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.064546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:17.067071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:17.079704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.080912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.081615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.109295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.109295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.109295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.136647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:17.158629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-379e0e9d-4245-42ea-b487-672f943c8356 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1250 microversion: 2.1 time: 0.159461 Sep 07 13:09:17.160567 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 246/498] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:16 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1250 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:17.170048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e3f37-5fdf-41a3-915e-c08bb110e38b", "tag": "4a2c29e9-6b33-425f-a21e-c1389e5e204a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:17.193969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.195126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.195983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.225343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] Creating event network-changed:4a2c29e9-6b33-425f-a21e-c1389e5e204a for instance 880e3f37-5fdf-41a3-915e-c08bb110e38b on hv-cinder-85331 Sep 07 13:09:17.234976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-08284fc7-e5aa-4e68-956d-59cb78a16183 req-7cf9e58b-b77d-40f5-9c4b-a1da4db8191e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071849 Sep 07 13:09:17.236210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 247/499] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:17.329810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:17.334357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:17.340267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0e479ce7-f525-4b23-9ceb-4a94b865e594 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.282180 Sep 07 13:09:17.340858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 253/500] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:17 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:17.400506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:17.401465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:17.404832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:17.413697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.414526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.415013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.415785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.416292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.416767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.653489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:17.663715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-211c0b75-4099-4517-8cf6-60ae2bef51bc tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.268564 Sep 07 13:09:17.664583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 248/501] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:17 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:17.995887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:17.996665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:18.004493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.005164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.005753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.006527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.007108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.007737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.188233 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:18.198066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d9d681ad-eb39-4a3e-a602-622f389387eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.208756 Sep 07 13:09:18.198762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 254/502] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:17 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:18.212519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:18.213661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:18.226227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.227126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.228844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.231189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.231734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.232212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.316511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:18.328330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-381f8f76-7c9f-49f3-80da-ea27acd8701a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1250 microversion: 2.1 time: 0.123902 Sep 07 13:09:18.328986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 249/503] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:18 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1250 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:18.379115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:18.380215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:18.387897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.388733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.389396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.390355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.391012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.391624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.615455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:18.633938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8c8ff950-75c4-4ab2-88c1-0c7687ae4af6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.256071 Sep 07 13:09:18.633938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 255/504] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:18 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:18.689942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:18.690555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:18.698273 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.698766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.699175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.700316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.700514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.701268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.896966 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:18.913618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-99b14255-64e8-4bad-9122-64c58dbd9f25 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.227806 Sep 07 13:09:18.914710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 250/505] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:18 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:19.235105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:19.236021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:19.239395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:19.251991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.252786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.253538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.254852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.255810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.256600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.358683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:19.364051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:19.399148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.400058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.400664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.401850 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.402745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.403261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.494450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:19.503801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d6f4acbf-5ef9-486c-80b0-f8f1ccd28b98 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1298 microversion: 2.1 time: 0.154207 Sep 07 13:09:19.504545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 251/506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:19 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:19.519739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:19.535118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c07e6d07-da90-4f19-b48a-a365f13c91a1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.303650 Sep 07 13:09:19.536244 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 256/507] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:19 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:19.671944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:19.672544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:19.679566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.680244 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.680768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.681727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.682447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.683062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.702290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:19.858735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:19.868129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b8cc743c-4548-48a9-b861-8e0dc38538bc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.202092 Sep 07 13:09:19.869041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 252/508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:19 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:19.944980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:19.945959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:19.956411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.957137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.957868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.959283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.959859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.960460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.153948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:20.165043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-605f57ec-b229-4e08-9f1c-2f3e29f47741 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.224747 Sep 07 13:09:20.165701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 257/509] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:19 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:20.541792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:20.542828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:20.549375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.549926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.550365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.551082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.551540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.551967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.577885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:20.579722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:20.590478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.591214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.591898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.598686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.598686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.598686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.636170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:20.651341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-664ac398-db9b-49df-9e44-6338d4895b3f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1298 microversion: 2.1 time: 0.114278 Sep 07 13:09:20.652355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 253/510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:20 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:20.792684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:20.801827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4cf39022-de74-4335-932b-63a1abe0cfa5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.230651 Sep 07 13:09:20.802429 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 258/511] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:20 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:20.893432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:20.894296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:20.902319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.902859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.903368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.904181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:20.904688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:20.905485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.091694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:21.101578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-52027962-2368-4a8f-a938-67f07ccf687c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.212643 Sep 07 13:09:21.102483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 254/512] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:20 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:21.191104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:21.191726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:21.199031 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.199710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.200362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.201301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.201806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.202265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.396072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:21.410508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-093079a2-8117-4988-81a8-f384dd8bdeba tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.223744 Sep 07 13:09:21.427740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 259/513] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:21 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:21.688784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:21.689545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:21.697705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.701811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.701811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.701811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.701811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.702804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.810936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:21.830635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b735052e-3405-4e38-a82e-9641baa55abb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1298 microversion: 2.1 time: 0.145987 Sep 07 13:09:21.832347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 255/514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:21 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:21.837013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:21.843501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:21.862033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.865615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.867093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.868628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.869924 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.871168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.127890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:22.128411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:22.136302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.136795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.137225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.138073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.138529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.139231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.194057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:22.212876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-44cb6992-3d56-4dfe-9b1e-158d02b44398 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.388083 Sep 07 13:09:22.214037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 260/515] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:21 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:22.443881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:22.445029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:22.464765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.465943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.466479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.468125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.469171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.470825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.841228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:22.870654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:22.890427 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-98ed380e-2f73-457e-8980-410e71c68c40 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.453933 Sep 07 13:09:22.892112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 261/516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:22 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:22.903671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:22.905295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:22.929789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-88595c42-c67f-42f7-b575-5e367e60331d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.801702 Sep 07 13:09:22.930879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 256/517] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:22 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:22.932861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.933698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.936557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.937543 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.938228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.938934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.124713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:23.143573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ba9c946d-c37a-43a2-ad39-2353903349e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1298 microversion: 2.1 time: 0.249332 Sep 07 13:09:23.145162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 262/518] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:22 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:23.244240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:23.244862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:23.252680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.253235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.253701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.254473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.254927 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.255348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.480793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:23.496998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-73da8ade-2c5b-4351-ab86-9ab574cbda5d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.256869 Sep 07 13:09:23.498150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 257/519] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:23 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:23.933023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:23.934130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:23.945164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.946241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.947126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.948495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.949707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.950913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.972649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:23.974235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:23.981935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.982785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.983563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.984549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.985470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.986241 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.529708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:24.584000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d53b51a5-924f-474c-808a-c7cb8726df7d tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.657893 Sep 07 13:09:24.586074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 263/520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:23 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:24.616609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:24.620951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:24.643564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.644189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.645388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.646219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.650232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.651355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.800082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:24.810191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2ac6bcc6-0b33-4224-9c77-f63db5a21c87 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1304 microversion: 2.1 time: 0.221857 Sep 07 13:09:24.811048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 264/521] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:24 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:24.817076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:24.818352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:24.848426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.853430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.855079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.858930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.862295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.865019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.042263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:25.059914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e5b9af1b-31c3-4700-b301-c29333b4966f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 1.091018 Sep 07 13:09:25.061598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 258/522] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:23 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:25.071894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd694b4-270a-4501-ba55-c9989f249ba3", "name": "network-vif-plugged", "status": "completed", "tag": "9cecf480-11f3-48d5-87f6-6f2db6a159cb"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:25.095173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.096997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.098628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.142698 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] Creating event network-vif-plugged:9cecf480-11f3-48d5-87f6-6f2db6a159cb for instance 0fd694b4-270a-4501-ba55-c9989f249ba3 on hv-cinder-85331 Sep 07 13:09:25.156486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-f043cbf1-ec3d-4d46-b44f-34164b64c33e req-a117a82c-dd56-440d-9278-5671d71d2cc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092596 Sep 07 13:09:25.159041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 259/523] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:25.274888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:25.309690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82d1b76f-cffa-4929-95bf-e4c75e25319d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.496218 Sep 07 13:09:25.311618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 265/524] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:24 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:25.628643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=8 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:25.637134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:25.637942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:25.645799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.647968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.649130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.650810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.651690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.652378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.852254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:25.852961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:25.861716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.862207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.862845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.864167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.864391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.864825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.890589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:25.914238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f3c8c8d5-6b70-4b8c-b11c-618ad994cf87 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.275315 Sep 07 13:09:25.914460 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 260/525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:25 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:26.092293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:26.093527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:26.105040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=32 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:26.108678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.109150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.116662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.117381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.123885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.124334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.223725 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:26.242289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d62ece7b-9e18-4702-90d9-a7f752be878c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.393137 Sep 07 13:09:26.247953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 266/526] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:25 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:26.336781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:26.337966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:26.352976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:26.369695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f528416c-387e-4674-984b-4c894db857c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.285455 Sep 07 13:09:26.370392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 261/527] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:26 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:26.373455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.374452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.374946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.376374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.376967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.377552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.639109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:26.655173 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-406d9c7b-f0ab-490f-a7e2-b8c6de708cff tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.322683 Sep 07 13:09:26.655661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 267/528] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:26 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:26.948320 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:26.949700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:26.961174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.962043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.962796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.964040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.964873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.965806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.188577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:27.199042 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d4fb5828-f54d-43a4-98d8-bf4783db47fe tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.258674 Sep 07 13:09:27.200041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 262/529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:26 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:27.288658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:27.288658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:27.296078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.296580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.297028 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.297856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.298326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.298754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.410846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:27.411774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:27.418902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.419864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.420479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.421410 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.422235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.422838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.589128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:27.609540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-43962052-a3ae-4d34-a848-364040109361 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.327344 Sep 07 13:09:27.611753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 268/530] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:27 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:27.619944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08cc93d9-9e4f-4c6a-adda-4f3f34ac099b", "name": "network-vif-plugged", "status": "completed", "tag": "555b5068-66f6-4c6e-b495-1103b4954fa4"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:27.648456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.649271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.650267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.670122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] Creating event network-vif-plugged:555b5068-66f6-4c6e-b495-1103b4954fa4 for instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b on hv-cinder-85331 Sep 07 13:09:27.678636 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-9e79bc70-ccc7-430f-8124-f1ad80a264a7 req-650634cf-b076-4f05-bdfa-c88e5d124339 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064432 Sep 07 13:09:27.679659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 269/531] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:27.697116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:27.698407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:27.708067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.709187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.709982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.711298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.711940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.712663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.712969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:27.729175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-41248f5b-8a59-4387-8658-40a6a7ace552 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.321796 Sep 07 13:09:27.730118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 263/532] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:27 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:27.942568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:27.954174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f181cafe-3ce2-4eff-94ce-5ec2093117eb tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.265401 Sep 07 13:09:27.955013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 270/533] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:27 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:28.242571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.243959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:28.255431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.256954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.257496 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.258855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.259694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.260517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.533871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:28.548597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-87f09af8-9e33-4aa5-9533-1434b53cddaf tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.314541 Sep 07 13:09:28.549621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 264/534] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:28.652995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.654328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:28.661165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.661699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.662265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.663210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.663445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.663908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.668880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:28.773746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.774536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:28.782994 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.783801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.784388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.785546 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.786286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.786822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.827027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:28.835959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dcc5c42a-e3e4-4bc0-9cc3-48c593db7f2a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.189105 Sep 07 13:09:28.836536 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 271/535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:28.952928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:28.963101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b0e11159-ab5a-4369-934d-6ca913d890ea tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.194163 Sep 07 13:09:28.963711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 265/536] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:28.986345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.987572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:29.002082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.002990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.003892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.005649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.007382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.008221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.385565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:29.400275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5d0be283-0390-4020-a42a-cc64277ca270 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.421354 Sep 07 13:09:29.403866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 272/537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:29.579283 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:29.581620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:29.611735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.613525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.614325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.616345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.617641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.618454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.863281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:29.865587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:29.868157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:29.884157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.886018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.887777 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.889873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.891095 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.892067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.895290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ced9972d-36b4-46f0-8f76-2084a02184b5 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.324057 Sep 07 13:09:29.896918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 266/538] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:29 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:29.996598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:29.998984 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:30.018206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.020521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.023641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.025551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.026989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.029577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.225029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:30.249097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb5d5a9c-6a27-4bc9-b0ff-c1a60fc1e8a6 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.392010 Sep 07 13:09:30.266625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 273/539] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:29 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:30.305755 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:30.315782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-08cfac61-2688-4be3-ba13-27e4f366a1f5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.330769 Sep 07 13:09:30.330104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 267/540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:29 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:30.444913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:30.446037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:30.457968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.459252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.460933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.474223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.474223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.474223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.495989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:30.515628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.516963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.517789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.540627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] Creating event network-changed:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:09:30.547531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-8838e49b-7fad-4279-a7d8-e1fe40d4d59b req-6d61a2b9-7a48-4b84-ba50-97780fa27514 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060156 Sep 07 13:09:30.548243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 268/541] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:30.690141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:30.705878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ffca064c-a773-4f41-8f66-97d8a2d7652b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.268266 Sep 07 13:09:30.706952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 274/542] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:30 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:30.932218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:30.933331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:30.948730 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.949463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.950247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.951259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.951847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.952469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.181281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:31.189659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1f616956-bc46-4ca8-b14e-41eaef33dcee tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1318 microversion: 2.1 time: 0.264616 Sep 07 13:09:31.190291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 269/543] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:30 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:31.282442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:31.283303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:31.290806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.291608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.292371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.293627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.294452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.295188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.344246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:31.345369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:31.357542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.358727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.359638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.362563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.362563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.362563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.380542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:31.491727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:31.507876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-583e609e-c15b-4de3-9987-6cbb7b39a9bb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.229838 Sep 07 13:09:31.508834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 275/544] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:31 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:31.550814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:31.560704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4582976b-b094-4b27-9788-4b9eae8b6e16 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.223823 Sep 07 13:09:31.561821 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 270/545] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:31 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:31.740412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:31.741801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:31.750572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.751449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.753139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.755425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.756837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.757779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.039636 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:32.051817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d885fb8-9bb4-4808-b1cc-c03aff371f1d tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.315221 Sep 07 13:09:32.053218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 276/546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:31 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:32.079806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e3f37-5fdf-41a3-915e-c08bb110e38b", "name": "network-vif-plugged", "status": "completed", "tag": "4a2c29e9-6b33-425f-a21e-c1389e5e204a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:32.098190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.099031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.100471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.123743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] Creating event network-vif-plugged:4a2c29e9-6b33-425f-a21e-c1389e5e204a for instance 880e3f37-5fdf-41a3-915e-c08bb110e38b on hv-cinder-85331 Sep 07 13:09:32.132883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-29b81903-f5e5-4e9f-8bbd-d0d9b00cd898 req-738dce1f-0eeb-4d7d-aa3b-dbbb512ccf45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060508 Sep 07 13:09:32.134153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 271/547] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:32.213922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:32.214627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:32.221972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.222476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.222914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.223676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.224131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.224559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.382399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:32.392875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-14a1afdc-badb-451b-97fb-0eefac3fd0d8 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1507 microversion: 2.1 time: 0.183687 Sep 07 13:09:32.393642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 277/548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:32 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:32.544279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:32.545308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:32.554405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.555216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.555834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.559189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.560091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.560832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.590458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:32.599318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:32.630787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.635087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.636813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.638898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:32.644076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:32.645383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.866522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:32.884064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-769fbaa1-cc7a-44ee-be5a-bd773ff93680 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.346710 Sep 07 13:09:32.886014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 272/549] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:32 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:32.969724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:32.985965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa45b0b4-d98b-4b00-8298-fe5fa0f51485 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1363 microversion: 2.1 time: 0.404246 Sep 07 13:09:32.987827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 278/550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:32 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:33.087806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:33.089177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:33.101575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.102516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.103142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:33.104521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.105296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.106239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:33.372003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:33.385763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-843aff1a-3e17-4238-ba41-ee4c46d067d5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.303239 Sep 07 13:09:33.394555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 273/551] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:33 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:33.913958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:33.914894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:33.924735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.925938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.926988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:33.927881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.928561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.929062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.029427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:34.029569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:34.037300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.037855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.038292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.038995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.039443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.040549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.115479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:34.129164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fd31fa19-4c08-4917-ba86-828abc7359ab tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.220765 Sep 07 13:09:34.130298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 279/552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:33 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:34.339825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:34.364653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dd790bbf-a548-4a94-838f-64bab8822f50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1548 microversion: 2.1 time: 0.342257 Sep 07 13:09:34.366431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 274/553] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:34 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1548 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:34.403050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:34.420048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:34.430175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:34.430175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:34.447348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.448585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.449345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.449909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.451825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.452919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.453844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.457388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.457388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.458478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.460507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.461360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.737327 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-adc8eb62-9c77-4bad-b5b5-60b3437da8cb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.341484 Sep 07 13:09:34.747869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 280/554] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:09:34 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-interface => generated 284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:34.845183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:34.866221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e3b012bf-2769-4f0e-b61e-00e3a4b06807 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.457241 Sep 07 13:09:34.867605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 275/555] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:34 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:35.169623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:35.170707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:35.180828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.181338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.181906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:35.182718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.183216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.183978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:35.540931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:35.564270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5eda6404-7f60-4889-b047-31de944bbcc9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.400543 Sep 07 13:09:35.565794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 281/556] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:35 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:35.909077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:35.910219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:35.935048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.935820 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.936399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:35.937308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.938250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.938975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:36.148926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:36.159561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a59b8285-682c-45ec-a74e-79fe1bc78624 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.258303 Sep 07 13:09:36.160271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 276/557] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:35 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:36.608542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:36.610842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:36.624258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:36.625316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:36.626625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:36.627747 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:36.628400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:36.629075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:36.936539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08cc93d9-9e4f-4c6a-adda-4f3f34ac099b", "tag": "555b5068-66f6-4c6e-b495-1103b4954fa4"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:36.953633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:36.954843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:36.955706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:36.972317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] Creating event network-changed:555b5068-66f6-4c6e-b495-1103b4954fa4 for instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b on hv-cinder-85331 Sep 07 13:09:36.980253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-28c209cd-06b3-4c35-8a7a-163769c41ef3 req-485863b9-92b7-4c52-9b57-0320d46d8290 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049371 Sep 07 13:09:36.981289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 277/558] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:37.085539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:37.094433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-76d5e756-3909-429e-b51b-b226d8d87b08 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.493811 Sep 07 13:09:37.095074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 282/559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:36 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:37.188196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:37.189794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:37.200791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.201130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.201770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.202670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.203332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.203918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.593205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:37.604025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d8b295d2-ab95-4566-811f-413a8c1487d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1313 microversion: 2.1 time: 0.424150 Sep 07 13:09:37.604742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 278/560] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:37 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:38.124686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:38.125721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:38.135767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:38.145073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.148872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.150461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.152326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.153628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.154922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.555031 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:38.565096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-15cca87b-8700-4331-9493-50c6c154a1a9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.446570 Sep 07 13:09:38.566098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 283/561] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:38 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:38.644430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:38.645761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:38.656899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.658182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.659093 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.660436 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.661997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.663727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.968501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:38.984321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cae51f23-6a5c-457a-b8a0-7bb8f711ede0 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1497 microversion: 2.1 time: 0.344939 Sep 07 13:09:38.985411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 279/562] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:38 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:39.595912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:39.596811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:39.609595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:39.610752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:39.611645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:39.613335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:39.614192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:39.615003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:39.824579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:39.838869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fee0ca0d-02ff-44ce-9762-8499f07b0f83 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.246840 Sep 07 13:09:39.839923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 284/563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:39 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:40.877452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:40.878647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:40.891134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:40.892031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:40.892829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:40.894136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:40.894968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:40.895712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:41.138378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:41.148293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e6f24763-d67a-4467-acf6-f8d2fcd130ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.278193 Sep 07 13:09:41.149360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 280/564] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:40 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:42.174393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:42.175540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:42.182989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:42.183611 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:42.184139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:42.184976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:42.185649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:42.186238 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:42.393800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:42.404728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-31bd90e2-8488-421e-ab83-c617a9badbd4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.234214 Sep 07 13:09:42.405648 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 285/565] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:42 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:43.439152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:43.440045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:43.448499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:43.449067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:43.449511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:43.450611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:43.451082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:43.451514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:43.654919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:43.664943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0ac61b51-bec4-471a-9607-d2df1a66deb2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.230300 Sep 07 13:09:43.665555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 281/566] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:43 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:44.692870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:44.693943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:44.705034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:44.705627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:44.706137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:44.707052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:44.707559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:44.708069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:44.892412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:44.902040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e4004cb6-b808-4562-8db1-0dc67aaa737d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.215919 Sep 07 13:09:44.902744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 286/567] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:44 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:45.927261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:45.928133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:45.935700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:45.936458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:45.936941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:45.937973 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:45.938542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:45.939038 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.131424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:46.147505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-61ec4344-8649-4c87-b018-491dc465ca34 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.223794 Sep 07 13:09:46.148447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 282/568] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:45 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:46.578365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:46.579242 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:46.590772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:46.591531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:46.592372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.593575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:46.594456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:46.595224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.627837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:09:46.646623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:46.726142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-12bdc75e-daed-487a-89ae-c7d571259d1b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "DELETE /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 204 len: 0 microversion: 2.1 time: 0.154546 Sep 07 13:09:46.726769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 287/569] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:09:46 2022] DELETE /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:09:46.735716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:46.736510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:46.745072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:46.746019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:46.746500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.747341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:46.748030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:46.748540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.914812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:46.923281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-40c83458-b806-4fd7-9297-74ac551b0d85 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1503 microversion: 2.1 time: 0.191730 Sep 07 13:09:46.923879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 283/570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:46 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:47.173952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:47.174568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:47.181307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.181906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.182352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.183089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.183661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.184105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.343470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:47.353156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-deb3313a-9aa8-4ad2-bbca-b7b23d522e4f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.183834 Sep 07 13:09:47.353818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 288/571] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:47 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:47.959158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:47.960151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:47.963606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=72 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:47.970717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.971363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.972091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.972923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.973696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.974423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:48.296854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:48.305434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2094283a-5f90-4eac-9db1-01d0938f88d1 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1503 microversion: 2.1 time: 0.353142 Sep 07 13:09:48.306061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 284/572] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:47 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:48.390980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:48.391996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:48.401471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:48.402259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:48.402943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:48.403968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:48.404489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:48.404956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:48.567619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:48.579525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-39873b96-ca7c-4cff-8992-2a44ca50a4fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.192686 Sep 07 13:09:48.580290 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 289/573] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:48 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:49.329078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:49.329788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:49.337587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:49.338183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:49.338759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:49.339564 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:49.340105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:49.340653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:49.515342 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:49.524753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-35720ed5-82fd-4ea5-a21f-95635be044f5 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1503 microversion: 2.1 time: 0.199837 Sep 07 13:09:49.530412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 285/574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:49 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:49.622303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:49.623124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:49.631599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:49.632397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:49.633120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:49.634309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:49.635062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:49.635754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:49.824973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:49.840157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-42289361-d225-42cf-8774-8e33746e0b1e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.223797 Sep 07 13:09:49.841110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 290/575] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:49 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:50.550132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:50.551006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:50.560607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.561284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.561893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:50.562685 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.563379 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.563899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:50.736087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:50.745359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-39392674-99e6-4f6c-8f6c-5c7e265f03af tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1503 microversion: 2.1 time: 0.200362 Sep 07 13:09:50.745996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 286/576] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:50 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:50.811575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:50.812211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:50.821070 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.822044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.822526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:50.823808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.824293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.824747 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:50.857226 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-228e8891-1957-4d27-8d36-36dcc60798bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.049953 Sep 07 13:09:50.858544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 291/577] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:09:50 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:50.870076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:50.871047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:50.881061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.881967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.882519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:50.883807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:50.884806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:50.885378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:51.230803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:51.250081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d7dc3a2b-7cb4-4292-8e28-8caf239dca92 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.386192 Sep 07 13:09:51.266292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 287/578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:50 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:51.696626 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e3f37-5fdf-41a3-915e-c08bb110e38b", "name": "network-vif-deleted", "tag": "4a2c29e9-6b33-425f-a21e-c1389e5e204a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:51.709329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:51.710633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:51.710940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:51.727886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] Creating event network-vif-deleted:4a2c29e9-6b33-425f-a21e-c1389e5e204a for instance 880e3f37-5fdf-41a3-915e-c08bb110e38b on hv-cinder-85331 Sep 07 13:09:51.741331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-6e2b3f7c-0b64-48f1-a02e-e338465c912f req-7734d643-9c78-474b-abb9-a3753e4b05aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049251 Sep 07 13:09:51.742339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 292/579] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:09:51.776191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:51.778210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:51.790876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:51.791903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:51.793148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:51.794491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:51.795620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:51.796527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:51.828721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:51.906217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86032a9fd3b8429b99a7d23ddaf03116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da3acfcc34b44a5909e036705c040c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:51.917382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-204aae30-3d88-40a5-a9e1-5548811d37a7 tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 200 len: 1298 microversion: 2.1 time: 0.150637 Sep 07 13:09:51.918058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 288/580] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:51 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 1298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:52.290435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:52.291128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:52.299654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:52.300231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:52.300710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:52.301543 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:52.302122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:52.302606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:52.486550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:52.496087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-94f91c44-c99f-445e-a62b-c8bcb370f71e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.210777 Sep 07 13:09:52.496932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 293/581] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:52 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:52.952570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:52.953316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] [instance: 880e3f37-5fdf-41a3-915e-c08bb110e38b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:52.962884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:52.963660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:52.964652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:52.965729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:52.966354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:52.966889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:52.984365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] HTTP exception thrown: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Request method failure captured: Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b HTTP/1.1 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJeqpK-0VoaqhHD0rIyHoyNbqnoiof73YpQ4YVbb_4xBWLjWrVm6s7tSGcVgFmWBrsIFjr3AoE5o0-PO3_xuKlQUhRIgdS6eGBQ2K9cCV9bzT79DJeqSU3JsuRTkCIwmjsOQkX_5ZFJSjdknM3RwAUgzHxaI9avYuRDiTx3ql4zEy2w Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 4da3acfcc34b44a5909e036705c040c8 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:09:52.986254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4da3acfcc34b44a5909e036705c040c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4da3acfcc34b44a5909e036705c040c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 4da3acfcc34b44a5909e036705c040c8 Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesActionsTest-1552885283 Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesActionsTest-1552885283-project Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 86032a9fd3b8429b99a7d23ddaf03116 Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesActionsTest-1552885283-project Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. Sep 07 13:09:52.990787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '880e3f37-5fdf-41a3-915e-c08bb110e38b'} Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:09:52.993380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. Sep 07 13:09:52.994832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:09:52.996140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] Returning 404 to user: Instance 880e3f37-5fdf-41a3-915e-c08bb110e38b could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:09:52.996140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-17d45d65-7cfd-42b0-bded-668a1e60015b tempest-VolumesActionsTest-1552885283 tempest-VolumesActionsTest-1552885283-project] 10.222.0.17 "GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b" status: 404 len: 111 microversion: 2.1 time: 0.040865 Sep 07 13:09:52.996140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 289/582] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:52 2022] GET /compute/v2.1/servers/880e3f37-5fdf-41a3-915e-c08bb110e38b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:09:53.093015 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:53.093406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:53.102217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.102810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.103243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.104458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.105183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.105989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.152296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-80965ada-c7e8-431c-9f68-b1d445bcc4a1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.063863 Sep 07 13:09:53.153530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 294/583] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Sep 7 13:09:53 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/ips => generated 152 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:09:53.215396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "name": "network-vif-plugged", "status": "completed", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:53.235230 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.236461 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.238156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.266363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] Creating event network-vif-plugged:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:09:53.288554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-30dc861c-b7cb-4005-979d-c2a230668f98 req-9f44f5d3-e6ec-42c8-abd4-cfbfee66d90f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086931 Sep 07 13:09:53.289237 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 290/584] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:53.538188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:53.541330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:53.557213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.558483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.559284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.560806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.561728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.562439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.741882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a73383f1-fb3e-4de9-8393-ec23adf1f617"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:53.753774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:53.783357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.788631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.789602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.790885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:53.791703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:53.792420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:53.974438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:53.988952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24ae869d-c1ba-41a4-82ff-445ab8f6e5ec tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.461427 Sep 07 13:09:53.990393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 295/585] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:53 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:54.766737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4ad45342-094f-480a-adbf-47ea7625baec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034508 Sep 07 13:09:54.767583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 291/586] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:09:53 2022] POST /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:55.032703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:55.033768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:55.044063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:55.044650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:55.045222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:55.046142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:55.046665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:55.047230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:55.229430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:55.239566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fccac6e4-e068-4acd-b5ed-dac7d4c42931 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.213897 Sep 07 13:09:55.240170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 296/587] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:55 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:56.266740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:56.267440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:56.275929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:56.276536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:56.277044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:56.277929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:56.278450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:56.278878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:56.441945 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:56.450786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-42e5e66c-9ddf-4c5c-b68d-d6c624859834 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.189636 Sep 07 13:09:56.451693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 292/588] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:56 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:56.825181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:56.826056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:56.833295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:56.833879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:56.834353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:56.835376 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:56.836630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:56.837100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:56.868209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lazy-loading 'flavor' on Instance uuid cd384fa3-24c0-47a6-8dc5-f6ad179994ef {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:09:57.173906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-79ef3dcf-5311-4476-adf7-3c54481371cc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/action" status: 202 len: 0 microversion: 2.20 time: 0.352668 Sep 07 13:09:57.174525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 297/589] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 13:09:56 2022] POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:09:57.183595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:57.184528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:57.193074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.193619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.194083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.194993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.195633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.196066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.404488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:57.423689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:57.426569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:57.428678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dac04876-c39a-4a7a-8157-d51d84438cbc tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.248899 Sep 07 13:09:57.429825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 293/590] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:09:57 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:09:57.478818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:57.479537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:57.486684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.487156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.487624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.488323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.488806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.489211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.644862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:57.654343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-92913bae-19b1-462f-9931-c46ee8fe2859 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.180169 Sep 07 13:09:57.654923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 298/591] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:57 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:58.455342 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:58.456002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:58.464551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:58.465314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:58.466016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:58.467132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:58.467837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:58.468505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:58.668498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:58.679538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:58.680224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:58.684328 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:58.686992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:58.687492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:58.687696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:58.687922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:58.688639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:58.689105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:58.689537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:58.690002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-15403df8-342f-4d14-910e-a27b04c663a9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.238309 Sep 07 13:09:58.691108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 294/592] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:09:58 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:09:58.857889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:58.867809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-90f2066d-13d1-480b-b496-44beb7cac113 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.192825 Sep 07 13:09:58.868498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 299/593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:58 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:59.718603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:59.719216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:59.726828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:59.727376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:59.727915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:59.728485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:59.728968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:59.729394 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:59.881646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:59.890553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:59.892018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:59.893203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-050e81df-e8ad-480c-a61b-39b67ff8996b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.178653 Sep 07 13:09:59.893965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 295/594] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:09:59 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:09:59.895990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:59.896871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:59.908327 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:59.909180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:59.909961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:59.911187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:59.911996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:59.912792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:00.080996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:00.089944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2d32f8cb-a095-40dc-97c3-b937e07cba31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.199954 Sep 07 13:10:00.090554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 300/595] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:59 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:00.920768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:00.921499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:00.929773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:00.930324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:00.930864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:00.931706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:00.932200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:00.932783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:01.089343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:01.098663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:01.100114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:01.101482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-88505787-f8b8-4d59-92fe-0260e5bae547 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.185512 Sep 07 13:10:01.102299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 296/596] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:00 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:01.112746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:01.113449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:01.120845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:01.121483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:01.122486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:01.122893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:01.123363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:01.123791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:01.279283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:01.288194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-23fc0a80-81ce-46c7-9207-1ede6efe6272 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.179334 Sep 07 13:10:01.288910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 301/597] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:01 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:02.133682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:02.134809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:02.146796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:02.147882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:02.148629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:02.150206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:02.151062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:02.151813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:02.312412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:02.313135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:02.313788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:02.321799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:02.322166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:02.322649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:02.323379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:02.323838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:02.324457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:02.329409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:02.332704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:02.334483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4003fa84-a1d7-4ee2-8296-85d51af1f6fe tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.208318 Sep 07 13:10:02.336514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 297/598] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:02 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:02.354202 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:02.545301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:02.556515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-532c48f7-6fed-49d7-a614-a49d5b7b0428 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1371 microversion: 2.1 time: 0.247370 Sep 07 13:10:02.557218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 302/599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:02 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:03.373039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:03.374432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:03.383110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.384116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.384544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.385819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.386419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.387083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.590523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:03.591251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:03.600089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.600620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.601341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.602406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.602940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.603763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.628995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:03.647181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:03.650585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:03.653497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4014e4c6-00e1-4361-a04e-afa041545467 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.285011 Sep 07 13:10:03.654575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 298/600] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:03 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:03.769861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:03.779804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f8e9a71c-791e-4611-bb40-a19843a6c487 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1564 microversion: 2.1 time: 0.194577 Sep 07 13:10:03.780418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 303/601] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:03 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:03.804107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:03.804659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:03.811079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.811565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.811995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.812697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.813144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.813557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.915101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-30ee90a1-55a4-4933-a877-2e75e3442249 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115253 Sep 07 13:10:03.915774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 299/602] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:10:03 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:04.687619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:04.688449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:04.696055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:04.696861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:04.697440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:04.698906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:04.699594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:04.700056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:04.979096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:04.992521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:04.993984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:04.995273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b790549e-8598-48e5-86cc-c1ffa55953a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.314928 Sep 07 13:10:04.995898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 304/603] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:04 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:05.180743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:05.191520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:05.192091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:05.192586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:05.206797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] Creating event network-changed:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:10:05.215302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-53048393-b67b-4c7d-8960-abc2d621cb48 req-a2325f57-2a08-4d45-bf6b-341bd11448c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039005 Sep 07 13:10:05.216400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 300/604] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:10:06.025732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:06.027064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:06.034664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:06.035490 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:06.036033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:06.036674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:06.037133 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:06.037549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:06.277653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:06.307007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:06.310273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:06.311891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f3eb37cf-2a86-450a-a935-faccc39502aa tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.293464 Sep 07 13:10:06.312533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 305/605] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:06 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:07.341174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:07.342769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:07.358295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:07.359264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:07.359988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:07.360978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:07.361450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:07.361931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:07.582622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:07.623017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:07.625820 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:07.627396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7efccc7e-8a39-49a7-8cbe-5cac350215ab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.292348 Sep 07 13:10:07.628168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 301/606] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:07 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:08.671540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:08.672909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:08.681404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:08.683020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:08.683618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:08.684143 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:08.685572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:08.686758 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:08.687442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:08.912622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:08.922628 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:08.924110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:08.925304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-35362361-0f0c-414e-9d72-510edf937d7e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.258793 Sep 07 13:10:08.938261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 306/607] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:08 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:09.954004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:09.955794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:09.964578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:09.965121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:09.965583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:09.966428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:09.966887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:09.967309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:10.438566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:10.454903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:10.458908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:10.460768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f366ef78-d111-44a5-850d-3ebba10c38b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.512145 Sep 07 13:10:10.461823 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 302/608] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:09 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:11.501661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:11.502409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:11.509712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:11.510254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:11.510664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:11.511379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:11.511827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:11.512242 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:11.690168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:11.698939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:11.700447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:11.701820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cebbb10c-de64-4018-abdb-c4785746f2c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.204694 Sep 07 13:10:11.702596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 307/609] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:11 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:12.313591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f76d54b-853d-4153-b7ce-8bbfef402b1d", "device": "/dev/sdb"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:12.317434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:12.333579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:12.333579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:12.333579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:12.333579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:12.334392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:12.334392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:12.732780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:12.735564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:12.749837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:12.750895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:12.751720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:12.753350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:12.755166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:12.756199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:13.079397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:13.095881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-07417213-40b1-488a-aba1-74e6d282c126 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "POST /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785887 Sep 07 13:10:13.096581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 303/610] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:10:12 2022] POST /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:13.097089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:13.099287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:13.100969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-724bc447-9061-4c93-b00f-09137896469f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.376337 Sep 07 13:10:13.102883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 308/611] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:12 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:13.519970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3efc0aab-dde9-4ff1-881c-224d12c3ae62 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: .version_select at 0x7fdc43325ee0>, body: {"keypair": {"name": "tempest-keypair-378439831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA+KahTrEOpUgGjKZbW3ey+8uqX3ctGwta8Lzn2Be9sloPLMhqLwM6RBh6gwlF4UjJ2P2VcWej8dUCzTlHFknA3R0/6PofCu4O07kiMKcF8q93Zh8A1kVY9Lu57TjBUzg=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:13.548736 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-3efc0aab-dde9-4ff1-881c-224d12c3ae62 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:10:13.557004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-3efc0aab-dde9-4ff1-881c-224d12c3ae62 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:10:13.592661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3efc0aab-dde9-4ff1-881c-224d12c3ae62 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078623 Sep 07 13:10:13.593350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 304/612] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:10:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:14.168548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:14.171911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:14.193526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.198541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.199231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.200335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.201102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.201730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.605216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:14.629709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:14.632970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:14.635428 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-54fab969-1355-4851-a3fc-df5299529043 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.507505 Sep 07 13:10:14.636660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 309/613] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:14 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:15.683660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:15.684807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:15.694399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:15.695053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:15.695660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:15.696392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:15.697030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:15.697819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:15.710326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1295962862", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b6a96b-b474-4212-8454-464c32633cf7"}], "security_groups": [{"name": "tempest-securitygroup--2090869301"}], "key_name": "tempest-keypair-378439831", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:15.963229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:15.967729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:15.983482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:15.986964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:15.989611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-06982af8-6516-4470-a2d7-dc1119fc1c9c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.313009 Sep 07 13:10:15.990784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 305/614] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:15 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:17.030220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:17.031369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:17.040656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:17.041599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:17.042384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:17.043374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:17.044005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:17.044611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:17.282871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:17.299832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:17.303541 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:17.305947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8dcc8541-b398-4bdb-a803-436d7122e4d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.280728 Sep 07 13:10:17.307572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 306/615] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:17 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:18.355246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:18.358118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:18.362447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:18.376536 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:18.377628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:18.378458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:18.379900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:18.381082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:18.381830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:18.620462 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:18.634841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:18.636434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:18.637705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f3f911a0-bcb8-49e0-a505-f7333bcadc3a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.290280 Sep 07 13:10:18.638280 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 307/616] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:18 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:19.668108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:19.669212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:19.676524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:19.677095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:19.677443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:19.678192 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:19.678637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:19.679053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:19.920908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:19.935608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:19.939475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:19.941555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-680e877b-3404-423d-95b3-5b4cfd42dd55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.280061 Sep 07 13:10:19.942701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 308/617] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:19 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:20.981871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:20.982950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:21.006188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:21.007410 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:21.011910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:21.013644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:21.014676 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:21.015628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:21.331800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:21.362723 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:21.367152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:21.372356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aaec948b-8d11-4602-b71f-1b95a9c561f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.395674 Sep 07 13:10:21.373796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 309/618] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:20 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:22.406047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:22.408022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:22.420723 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:22.421871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:22.423037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:22.424296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:22.424942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:22.425910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:22.663895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:22.684847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:22.696495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:22.700122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bbd78414-bf3f-46c7-96e3-de51c57481e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.299031 Sep 07 13:10:22.701304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 310/619] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:22 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:23.318550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] validate_networks() for [('58b6a96b-b474-4212-8454-464c32633cf7', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:10:23.740503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:23.743653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:23.754844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=4 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:23.759923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:23.760828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:23.761613 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:23.762940 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:23.763750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:23.764509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:23.938796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:10:23.939545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:10:23.940394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:10:23.941130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:10:23.941905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:10:23.959588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:23.960432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:23.961316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:23.962767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:23.963008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:23.963580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:23.964264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:23.980267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:23.982050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:23.984376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-71659796-a10a-446b-9f3b-fffa572d27f3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.251178 Sep 07 13:10:23.985405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 311/620] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:23 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:24.002849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:10:24.012323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:10:24.034944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:10:24.040530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:10:24.133604 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f566a59-9523-43a6-84f1-00877b859733 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.427556 Sep 07 13:10:24.134333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 310/621] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:10:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 8429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:10:24.150356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b82b689f-8033-4a18-8940-959b688530b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:24.151079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b82b689f-8033-4a18-8940-959b688530b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:24.248552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b82b689f-8033-4a18-8940-959b688530b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:24.258837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b82b689f-8033-4a18-8940-959b688530b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1241 microversion: 2.1 time: 0.114657 Sep 07 13:10:24.259919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 312/622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:24 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:25.018965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:25.019976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:25.029973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:25.030828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:25.031371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:25.032212 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:25.032940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:25.033536 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:25.185036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:25.194577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:25.196190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:25.197633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2954e60b-29f0-4aff-a536-74afdc5c488c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.188694 Sep 07 13:10:25.198297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 311/623] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:25 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:25.286037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:25.287186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:25.301219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:25.301360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:25.302172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:25.303473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:25.304301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:25.306051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:25.382790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:25.391661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e0c9a7b0-d017-4e4b-b7a5-06070f528433 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1245 microversion: 2.1 time: 0.110002 Sep 07 13:10:25.392522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 313/624] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:25 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:26.223824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:26.224671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:26.232231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:26.232730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:26.233171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:26.234017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:26.234703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:26.235321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:26.411029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:26.420209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:26.421655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:26.422883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1b5ee664-cccf-4246-9224-7e27ddf2e7c7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.203013 Sep 07 13:10:26.423457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 312/625] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:26 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:26.430770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:26.431445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:26.439272 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:26.439756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:26.440186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:26.440890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:26.441333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:26.441772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:26.516234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:26.528913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-60b24f55-1549-413d-843e-f908cdc1b00d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1245 microversion: 2.1 time: 0.103493 Sep 07 13:10:26.529763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 314/626] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:26 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:27.478842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:27.479654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:27.490128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:27.491017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:27.491824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:27.493360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:27.494563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:27.495348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:27.553933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:27.554643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:27.561818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:27.562289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:27.562722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:27.563527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:27.563976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:27.564399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:27.643738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:27.654757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-93c1e4f4-843d-4e9a-bae8-4969ffb81d14 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1245 microversion: 2.1 time: 0.105059 Sep 07 13:10:27.656381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 315/627] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:27 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:27.704558 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:27.714466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:27.715919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:27.717209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8e6e381c-402f-4b69-8fae-37256076b73c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.256869 Sep 07 13:10:27.717817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 313/628] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:27 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:28.694539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:28.695371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:28.703861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:28.704414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:28.704905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:28.705695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:28.706205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:28.706668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:28.749712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:28.750657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:28.761191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:28.761922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:28.762596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:28.763822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:28.764645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:28.765403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:28.777814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:28.786504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a39c45bb-89e6-4bd0-ad96-c04c21a1e7c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1245 microversion: 2.1 time: 0.095739 Sep 07 13:10:28.787260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 316/629] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:28 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:28.954383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:28.963637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:28.965248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:28.966735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-938153d3-46ff-4e62-8893-625dfdafd68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.226577 Sep 07 13:10:28.974789 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 314/630] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:28 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:29.810873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:29.811635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:29.833351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.834289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.835036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.836080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.836922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.837575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.935594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:29.944817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8c51fef0-8b3d-404d-a390-3db1c21e1d46 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1293 microversion: 2.1 time: 0.138084 Sep 07 13:10:29.955990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 317/631] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:29 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:29.999833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:30.001105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:30.014646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.015624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.016182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:30.017130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.017702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.018219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:30.349555 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:30.360123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:30.361810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:30.363367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4e2c57c4-f047-45d0-8667-05f9645e6bd2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.372669 Sep 07 13:10:30.372740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 315/632] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:29 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:30.971787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:30.973064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:30.983362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.985223 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.986936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:30.988151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.989149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.989964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:31.083319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:31.111137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b37c5b71-f23b-4f79-a43c-8a68927c16dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1293 microversion: 2.1 time: 0.143586 Sep 07 13:10:31.112502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 318/633] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:30 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:31.399394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:31.401365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:31.409521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:31.410534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:31.411118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:31.411988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:31.412432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:31.412993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:31.615063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:31.626089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:31.627837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:31.629314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-99fce433-2bc1-441b-9610-69ae35be44d7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.234184 Sep 07 13:10:31.629914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 316/634] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:31 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:32.151912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:32.155396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:32.183563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:32.184072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:32.184517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:32.185288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:32.185833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:32.186271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:32.284434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:32.295146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5976f97d-b9ab-4c2e-9ead-73c09ccb319b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.151405 Sep 07 13:10:32.296377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 319/635] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:32 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:32.665771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:32.667124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:32.674893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:32.675684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:32.676126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:32.677068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:32.677797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:32.678468 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:32.681885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=83 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:32.914683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:32.933787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:32.937009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:32.944483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-099aa079-a8d5-4791-a35c-e595ef20708e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.282520 Sep 07 13:10:32.946752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 317/636] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:32 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:33.326757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:33.327569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:33.342184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:33.343178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:33.344083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:33.345165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:33.345641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:33.346277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:33.484016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:33.518919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e8c725ba-c3dc-4c73-877c-ceaf39b2dde3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.200346 Sep 07 13:10:33.519839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 320/637] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:33 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:33.984757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:33.985892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:33.988371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:33.994965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:33.995773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:33.996216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:33.996936 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:33.997394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:33.997936 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:34.026724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:34.239690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:34.256273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:34.258836 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:34.261076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ed3e3123-846c-47b0-a741-f642c8b8e9c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.280828 Sep 07 13:10:34.262910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 318/638] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:33 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:34.560985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:34.562314 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:34.565425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:34.576880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:34.578361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:34.579373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:34.580461 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:34.581151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:34.581852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:34.702062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:34.710886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-02da1302-d6ce-428a-a715-be84f3e6253a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.157993 Sep 07 13:10:34.711573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 321/639] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:34 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:35.305551 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:35.306525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:35.314151 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:35.315175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:35.315869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:35.317235 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:35.317991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:35.318587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:35.577095 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:35.591494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:35.593582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:35.595187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e1e6da82-3dbd-4035-afc3-e828b7831f55 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.294210 Sep 07 13:10:35.610208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 319/640] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:35 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:35.742114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:35.744763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:35.756878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:35.758312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:35.759470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:35.761118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:35.762029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:35.762827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:35.858899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:35.873893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-26def3d0-8c18-40f7-9a76-b260699c4e2a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.139168 Sep 07 13:10:35.875313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 322/641] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:35 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:36.635594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:36.636401 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:36.643363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:36.643868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:36.644308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:36.645043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:36.645633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:36.646379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:36.834691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:36.844437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:36.846178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:36.847658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-196997ea-2156-4b83-a11c-d060bc37573c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.217912 Sep 07 13:10:36.848322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 320/642] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:36 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:36.901905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:36.902520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:36.909844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:36.910357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:36.910805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:36.911557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:36.912016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:36.912440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:36.931473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:37.004702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:37.013556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7e4ecbea-241e-49f4-9c69-52c632e516ac tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.117077 Sep 07 13:10:37.014208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 323/643] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:36 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:37.875706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:37.876417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:37.883929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:37.884461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:37.884925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:37.885660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:37.886155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:37.886585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:38.056929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:38.057914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:38.059997 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:38.069856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:38.070156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:38.070691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:38.071527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:38.071728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:38.072450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:38.072925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:38.073114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b658157-b6c0-4516-9b93-f7ebd6f2644b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.201486 Sep 07 13:10:38.073358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:38.073544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 321/644] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:37 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:38.146145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:38.156952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0bfe9662-064a-41b8-8726-e49a08def71d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.108012 Sep 07 13:10:38.157557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 324/645] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:38 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:39.101185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:39.101890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:39.104703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:39.112149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:39.112610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:39.113046 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:39.113986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:39.114698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:39.115144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:39.181258 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:39.182206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:39.189495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:39.190031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:39.190478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:39.191193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:39.191651 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:39.192076 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:39.291061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:39.295105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:39.301346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6d4bbd90-5265-4940-81cc-012ec8f2733d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.124288 Sep 07 13:10:39.302134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 325/646] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:39 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:10:39.305316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:39.307280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:39.308768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2634b3d6-2289-4659-ae82-a27260863e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.211793 Sep 07 13:10:39.309361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 322/647] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:39 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:40.332891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:40.334316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:40.349819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:40.354910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:40.366818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:40.375048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:40.376516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:40.377271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:40.378999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:40.379792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:40.380783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:40.385796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:40.386583 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:40.387884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:40.388730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:40.389476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:40.537223 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:40.558986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-09712f6c-7f18-4c99-8abc-3abdf16db005 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1299 microversion: 2.1 time: 0.233023 Sep 07 13:10:40.560089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 326/648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:40 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:40.798958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:40.813279 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:40.815410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:40.816719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1678a6cf-7151-48a9-b05f-f33ad0896c45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.475973 Sep 07 13:10:40.817331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 323/649] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:40 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:10:41.598952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.599604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:41.607317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:41.607814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:41.608259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:41.608983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:41.609437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:41.609924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:41.816363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:41.827892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7a21136c-42e8-43a1-a889-cd83da9a54b2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.233187 Sep 07 13:10:41.828859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 327/650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:41 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:41.852786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.853772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:41.864623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:41.865506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:41.866180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:41.867494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:41.868622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:41.869657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:42.167193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:42.184510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:42.188335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:42.190938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f48fb0e6-4063-4f33-ae60-f9c7e8ff0ad0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.346940 Sep 07 13:10:42.193840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 324/651] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:41 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:42.232504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "name": "network-vif-plugged", "status": "completed", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:42.245634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:42.246751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:42.247354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:42.262218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] Creating event network-vif-plugged:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:10:42.270465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-cb0a1259-9f5e-4055-b2f3-f2373d6e0408 req-bc21572d-0284-409b-ab08-91be55549478 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042057 Sep 07 13:10:42.271815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 328/652] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:42.353967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557046c4-53f5-4652-abb6-20ae0c1143f0", "tag": "2ba83860-5dc2-4073-8587-d6af429173cf"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:42.376337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:42.376885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:42.377477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:42.393257 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] Creating event network-changed:2ba83860-5dc2-4073-8587-d6af429173cf for instance 557046c4-53f5-4652-abb6-20ae0c1143f0 on hv-cinder-85331 Sep 07 13:10:42.399637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-67b8b747-6b3f-4336-9201-a5dd1c0f21e6 req-d45e196e-0694-4de2-845b-105c029ac946 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052539 Sep 07 13:10:42.400308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 325/653] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:42.862170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:42.863067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:42.876566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:42.877233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:42.877933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:42.878996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:42.879838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:42.880795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:43.114206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:43.126442 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-27d3c286-5e6a-46d5-a6e4-bd21a9a7c0ad tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.271882 Sep 07 13:10:43.145088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 329/654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:42 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:43.225340 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:43.227208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:43.238717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:43.239308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:43.239755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:43.242246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:43.243269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:43.243710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:43.440510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:43.451018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:43.452612 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:43.453932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b624431a-4387-4f72-b3af-2563736716fd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.235705 Sep 07 13:10:43.454529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 326/655] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:43 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:44.175738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:44.176744 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:44.188805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:44.189337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:44.189810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:44.190631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:44.191090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:44.191614 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:44.357405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:44.366100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ec989c2a-8973-47de-acf8-63bd03fda8c1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.197510 Sep 07 13:10:44.366689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 330/656] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:44 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:44.480746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:44.481614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:44.489595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:44.490292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:44.490941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:44.491778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:44.492328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:44.493090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:44.687937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:44.700286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:44.702137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:44.703581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7b63e73f-6dcb-4786-8091-a39d84e822a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.226696 Sep 07 13:10:44.704483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 327/657] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:44 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:45.405129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:45.406292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:45.414151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:45.414846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:45.415290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:45.416172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:45.416552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:45.416910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:45.623147 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:45.631639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b7636ede-6f36-4de2-b03f-4237bf95a4b7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.232495 Sep 07 13:10:45.632238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 331/658] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:45 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:45.730838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:45.731440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:45.738935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:45.739423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:45.739853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:45.740559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:45.741036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:45.741458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:45.915650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:45.930565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:45.933417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:45.935529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5fa71688-143d-4d28-8c43-0059ba02e111 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.208486 Sep 07 13:10:45.936934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 328/659] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:45 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:46.671710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:46.672337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:46.680763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:46.681275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:46.681756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:46.682515 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:46.682983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:46.683418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:46.864619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:46.873220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e81fd11c-9e1c-402c-be40-c8d855d26029 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.205469 Sep 07 13:10:46.873846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 332/660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:46 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:46.980069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:46.980693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:46.988194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:46.988691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:46.989126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:46.989882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:46.990332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:46.990751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:47.166334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:47.175817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:47.177600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:47.178995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8743905d-2c3f-40a3-b08d-74f14d4f666f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.203752 Sep 07 13:10:47.179657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 329/661] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:46 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:47.902798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:47.903755 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:47.915135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:47.916184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:47.916933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:47.918131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:47.918915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:47.919638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:48.108930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:48.117956 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4fae759c-86e7-4f05-9c60-abf8231fcf4c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.222339 Sep 07 13:10:48.119190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 333/662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:47 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:48.205389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:48.206034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:48.213196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:48.213701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:48.214138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:48.214843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:48.215296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:48.215716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:48.391339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:48.406134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:48.408596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:48.410581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-90d779ab-853f-4ad9-a704-60470b589ab4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.209507 Sep 07 13:10:48.411528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 330/663] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:48 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:49.143765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:49.144386 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:49.147048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=56 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:49.154388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:49.154864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:49.155299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:49.156012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:49.156463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:49.156908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:49.307197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:49.321976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6488c771-0cc8-4114-9eda-8f590c051da5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.181693 Sep 07 13:10:49.323121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 334/664] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:49 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:49.442307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:49.443364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:49.451170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:49.451693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:49.452152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:49.452966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:49.453432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:49.453904 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:49.645063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:49.654901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:49.656387 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:49.657609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-59371293-cd3b-43a4-85ff-58c77f9daecd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.219545 Sep 07 13:10:49.661224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 331/665] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:49 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:50.361779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:50.362534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:50.370396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:50.370920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:50.371342 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:50.372058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:50.372518 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:50.372942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:50.525100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:50.534231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b177e6bc-5076-429f-80e5-807065d8754a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.176285 Sep 07 13:10:50.534822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 335/666] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:50 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:50.685318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:50.686078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:50.693618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:50.694216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:50.694647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:50.695382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:50.695815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:50.696389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:50.854516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:50.862782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:50.864443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:50.865462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24de49eb-ddb7-4739-9997-40ada42080a6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.184973 Sep 07 13:10:50.866037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 332/667] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:50 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:51.563617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:51.564630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:51.574291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:51.575066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:51.575665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:51.576764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:51.577305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:51.577790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:51.871621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:51.880718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-999fcd62-3773-4e4e-bc06-ee6393aa3ead tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.325324 Sep 07 13:10:51.881339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 336/668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:51 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:51.893455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:51.894321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:51.904260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:51.904902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:51.905358 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:51.906165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:51.906681 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:51.907283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:52.129489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:52.142052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:52.143948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:52.146404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f5bcbe97-acf4-4a49-9626-dd88eb1a6e8f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.257166 Sep 07 13:10:52.147435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 333/669] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:52.919582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:52.920451 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:52.929855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:52.931908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:52.932527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:52.933738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:52.934319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:52.935092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:53.144208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:53.159849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-77a83df6-6238-4557-8d8c-7cbd659f1641 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.244322 Sep 07 13:10:53.161073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 337/670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:52 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:53.177587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:53.178609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:53.185947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:53.186458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:53.186898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:53.187717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:53.188074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:53.188739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:53.206013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:53.396794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:53.416851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:53.419387 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:53.421534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e4c3f49f-6582-41fb-9e08-46d6ae43e839 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.248576 Sep 07 13:10:53.432735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 334/671] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:53 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:54.188137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:54.189910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:54.199757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.200376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.200957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:54.201847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.203080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.203080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:54.421929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:54.436476 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fb8a242c-17ec-4f80-afd5-e59314e46792 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.252611 Sep 07 13:10:54.437420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 338/672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:54 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:54.454088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:54.455112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:54.465421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.466510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.467249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:54.468445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.469118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.469633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:54.667389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:54.687565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:54.693040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:54.696010 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f391d7c4-edf3-4d59-abfb-d9a8f2ce1e9b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.247971 Sep 07 13:10:54.697174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 335/673] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:54 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:54.931030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:54.931934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:54.943148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.943903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.944571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:54.945865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:54.946714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:54.947531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.117535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lazy-loading 'services' on Instance uuid 0fd694b4-270a-4501-ba55-c9989f249ba3 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:10:55.278104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9e300695-eaad-4db9-be85-db17bb0adeb6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3/os-volume_attachments/6f76d54b-853d-4153-b7ce-8bbfef402b1d" status: 202 len: 0 microversion: 2.1 time: 0.353830 Sep 07 13:10:55.279255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 339/674] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:10:54 2022] DELETE /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3/os-volume_attachments/6f76d54b-853d-4153-b7ce-8bbfef402b1d => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:10:55.467865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:55.469034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:55.483439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.484412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.486237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.489108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.491349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.493936 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.693126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:55.709791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8997958-19f6-4f26-a4c8-0d2db38d2b0a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.250587 Sep 07 13:10:55.710878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 336/675] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:55 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:55.746668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:55.747699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:55.758210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.759570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.760179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.761358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.762148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.762872 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.770591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:56.022359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:56.039556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:56.043756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:56.046302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f2f57fcf-5159-4ff6-acca-29a2128b59b6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1746 microversion: 2.20 time: 0.307076 Sep 07 13:10:56.047693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 340/676] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:55 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1746 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:56.752739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:56.753868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:56.761923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:56.762421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:56.762860 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:56.763590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:56.764044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:56.764480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:56.948730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:56.984143 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c7cbfa2e-3a50-45d1-b708-6e576fbac08f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.237298 Sep 07 13:10:56.997767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 337/677] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:56 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:57.092310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:57.094516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:57.107483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:57.109089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:57.110690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:57.116579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:57.116579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:57.116579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:57.428714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:57.447854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:57.451186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:57.463571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-321d72b2-db3e-4676-9b54-cfc04c15895a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.368892 Sep 07 13:10:57.464955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 341/678] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:57 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:58.027915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:58.028588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:58.035646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:58.036145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:58.036578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:58.037593 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:58.038413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:58.038572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:58.292722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:58.307531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2b3b7ecc-5cf5-4620-bd66-5dd9edb13e71 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.283594 Sep 07 13:10:58.308329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 338/679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:58 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:58.499656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:58.501538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:58.513507 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:58.514423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:58.515142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:58.516209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:58.516892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:58.517529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:58.775649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:58.792193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:58.795388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:58.797916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f320c6d4-a770-494f-bc72-ec8a7c987fab tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.302551 Sep 07 13:10:58.798808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 342/680] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:58 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:10:59.333104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:59.334581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:59.343435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.345041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.347851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.352564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.353740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.354447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.490159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557046c4-53f5-4652-abb6-20ae0c1143f0", "name": "network-vif-plugged", "status": "completed", "tag": "2ba83860-5dc2-4073-8587-d6af429173cf"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:59.514758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.516191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.517015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.532334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] Creating event network-vif-plugged:2ba83860-5dc2-4073-8587-d6af429173cf for instance 557046c4-53f5-4652-abb6-20ae0c1143f0 on hv-cinder-85331 Sep 07 13:10:59.543675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-5f88d3a2-127d-4f77-8bf7-0e81f33a485f req-ac313220-cd29-4796-9eb6-9a25a8069cd3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057487 Sep 07 13:10:59.545334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 343/681] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:10:59.617019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:59.653048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d427107-483e-4e0c-aef0-11d16dd85140 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.324476 Sep 07 13:10:59.655170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 339/682] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:59 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:59.825240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:59.826005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:59.839465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.841711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.842715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.843676 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.846213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:59.846732 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.847183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.847334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:59.872351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.872745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.873182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.876269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:59.877481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:59.878984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:59.917121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:11:00.111707 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1d59e8ba-fda1-43c2-aea4-b7566f947560 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 204 len: 0 microversion: 2.1 time: 0.291310 Sep 07 13:11:00.112938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 344/683] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:10:59 2022] DELETE /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:11:00.132867 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:00.134655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:00.143321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:00.144188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:00.144957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:00.145975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:00.146722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:00.148132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:00.265962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:00.279075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:00.285846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:00.293476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7934f97d-b53d-4c94-8a13-1558781dd86e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.451067 Sep 07 13:11:00.295810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 340/684] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:10:59 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:00.404742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:00.419308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a2813a27-34c8-4a9d-92e5-97da73cf9288 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1513 microversion: 2.1 time: 0.295764 Sep 07 13:11:00.419905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 345/685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:00 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:00.685402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:00.687189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:00.695858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:00.702148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:00.702148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:00.702148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:00.702148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:00.703148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:00.960234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:00.968992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8a0870bb-4f99-44ca-9c2a-efcf90825323 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.291752 Sep 07 13:11:00.969601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 341/686] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:00 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:01.335426 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:01.338664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:01.348749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.350039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.351249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.355122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.356235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.357204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.451595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:01.462424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:01.516360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.518168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.525249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.535506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.536552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.537270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.806531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:01.817852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:01.819365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:01.820787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e3212b85-c3c9-4045-9996-f874b97ba16c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.492947 Sep 07 13:11:01.821563 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 346/687] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:01 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:01.869125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:01.878702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0aefc167-6703-4bcb-ac67-bcf384990e7c tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1513 microversion: 2.1 time: 0.438628 Sep 07 13:11:01.879413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 342/688] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:01 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:02.013330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:02.014025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:02.024236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.024236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.024971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.025742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.026216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.026653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.261403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:02.277810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-43b97c31-a71b-4502-8c39-a71860a7c155 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.265274 Sep 07 13:11:02.296727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 347/689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:02 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:02.854487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:02.859709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:02.875717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.887424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.888695 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.890323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.891553 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.892649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.905030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:02.905921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:02.919619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.921365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.923002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.923809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.927389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.928751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:03.145926 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:03.155861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:03.158869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:03.160287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bed89209-66e6-45fd-99e8-bc52b292978b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.314896 Sep 07 13:11:03.173712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 343/690] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:02 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:03.197587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:03.208046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7f2499fb-8a24-4ffd-bb62-1093ac77a9b4 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1513 microversion: 2.1 time: 0.309255 Sep 07 13:11:03.208642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 348/691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:02 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:03.312607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:03.317406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:03.325416 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:03.325987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:03.326698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:03.327410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:03.328040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:03.328462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:03.559498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:03.572615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-14e7193d-33e2-4a94-9af3-a5e14e636221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.263632 Sep 07 13:11:03.575116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 344/692] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:03 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:04.190427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:04.192279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:04.200972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.201822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.202690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.204211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.205298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.206065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.250957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:04.253257 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:04.282518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.284288 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.306464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.307678 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.308354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.308844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.586048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.613036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.615680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.618298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e8e74580-23b9-42c9-81c7-47443d4f9913 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.433995 Sep 07 13:11:04.621448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 349/693] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:04 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:04.631839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:04.633590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:04.663277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.664789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.666940 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.668568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.669542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.670910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.844746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.859376 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2173a157-f98b-4b7f-8e33-199f0876e493 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1513 microversion: 2.1 time: 0.618683 Sep 07 13:11:04.883187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 345/694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:04 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1513 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:04.905394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd694b4-270a-4501-ba55-c9989f249ba3", "name": "network-vif-deleted", "tag": "9cecf480-11f3-48d5-87f6-6f2db6a159cb"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:04.918960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.918960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.926638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.964537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] Creating event network-vif-deleted:9cecf480-11f3-48d5-87f6-6f2db6a159cb for instance 0fd694b4-270a-4501-ba55-c9989f249ba3 on hv-cinder-85331 Sep 07 13:11:04.974964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-b7982d9f-393a-4136-a1a3-7d40ac9c5c32 req-6144d97b-e2ae-463b-8a64-fa257163af3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075066 Sep 07 13:11:04.984331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.986041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 346/695] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:04.992789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b6c9c399-e5d4-4fe4-b5be-ae3a3d06ea5f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1367 microversion: 2.1 time: 0.369247 Sep 07 13:11:04.997758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 350/696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:04 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:05.657251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:05.658512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:05.694088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.694936 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.696817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.703999 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.705656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.706839 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.901479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:05.902544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:05.915796 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.917565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.918750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.920710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.921902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.922925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.035639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.036576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.037367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.038209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lazy-loading 'fault' on Instance uuid 0fd694b4-270a-4501-ba55-c9989f249ba3 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:11:06.105258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.167370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.172002 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.194746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.199882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7d0c0667-5699-4e58-b27c-c6397921533c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.551214 Sep 07 13:11:06.201947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 347/697] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:05 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:06.212663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:06.213992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:06.243399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.252505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.254841 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.267237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.268722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.269661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.272875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7535681e-88dd-463a-9445-940cfde3694f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 200 len: 1308 microversion: 2.1 time: 0.378513 Sep 07 13:11:06.274511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 351/698] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:05 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:06.546239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.555128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-391351fb-2f0c-47c8-8cd8-7333fce58131 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1557 microversion: 2.1 time: 0.350353 Sep 07 13:11:06.556581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 348/699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:06 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1557 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:06.592494 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:06.593788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:06.602400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.604389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.605594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.606869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.607853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.608661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.754626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f422f907-0aa5-4150-bb73-41803cec4221 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170379 Sep 07 13:11:06.765636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 352/700] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:11:06 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:07.271782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:07.271782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:07.294970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.295901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.296606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:07.297771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.298569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.299210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:07.320533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:07.321746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: 0fd694b4-270a-4501-ba55-c9989f249ba3] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:07.360020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.360625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.361148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:07.362068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.362599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.363090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:07.385696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] HTTP exception thrown: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Request method failure captured: Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 HTTP/1.1 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJfrYn4sFUIBjaC0gzksEEsUPHW26d9JjIBza3jO0N9-HRVP3GKm9Fc-6MzQGpD_2oAhFpzeh3PzHrnBuEBErUPC0WCs6tqIY7QnJDnXFnnoQ-B3SP-BwxA6gCqYoSmh6HtsUU9v8OnUqU71Mk_GGHPJ5zKX7EuT_4MJwGr7ei7ap1U Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 73afbf716079452ba1deb906dbdce949 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:11:07.387857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73afbf716079452ba1deb906dbdce949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73afbf716079452ba1deb906dbdce949", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73afbf716079452ba1deb906dbdce949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73afbf716079452ba1deb906dbdce949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 73afbf716079452ba1deb906dbdce949 Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesSnapshotTestJSON-942519821-project Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: b22dd3b0461747688993851ccf4e66d0 Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesSnapshotTestJSON-942519821-project Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. Sep 07 13:11:07.389259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '0fd694b4-270a-4501-ba55-c9989f249ba3'} Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:11:07.390062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. Sep 07 13:11:07.391340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:11:07.394642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Returning 404 to user: Instance 0fd694b4-270a-4501-ba55-c9989f249ba3 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:11:07.396971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5e2f8012-df8f-4857-921e-20b979cd4c38 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3" status: 404 len: 111 microversion: 2.1 time: 0.084603 Sep 07 13:11:07.397923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 353/701] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:07 2022] GET /compute/v2.1/servers/0fd694b4-270a-4501-ba55-c9989f249ba3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:11:08.100868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.121148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.124559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.127742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f54d7e5d-46cd-4ae9-a86f-c2166d1f07c1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.863236 Sep 07 13:11:08.129954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 349/702] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:07 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:09.088095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557046c4-53f5-4652-abb6-20ae0c1143f0", "tag": "2ba83860-5dc2-4073-8587-d6af429173cf"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:09.099280 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.100108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.100742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.114388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] Creating event network-changed:2ba83860-5dc2-4073-8587-d6af429173cf for instance 557046c4-53f5-4652-abb6-20ae0c1143f0 on hv-cinder-85331 Sep 07 13:11:09.122993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-8420093d-1cab-4852-a3c4-ea73b2d02923 req-73e31d89-4ad4-4f24-9679-082fd50def6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038320 Sep 07 13:11:09.124877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 354/703] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:09.165040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:09.165040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:09.181496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=56 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:09.183958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.184532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.185007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.185828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.186534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.187164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.469163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:09.484306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:09.484306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:09.484306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b1d7a1c-904b-4eb0-b5b4-abb419110b86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.323686 Sep 07 13:11:09.506981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 350/704] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:09 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:10.523025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:10.526262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:10.544197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.545751 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.546423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:10.547374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.548074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.548697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:10.836133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.847883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.851978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.854840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-30a5a0dd-0071-4cec-933e-a50b422a9f08 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.341151 Sep 07 13:11:10.864884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 355/705] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:10 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:11.884072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:11.884823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:11.892671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:11.893160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:11.893594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:11.894348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:11.894903 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:11.895357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.064752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:12.068112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:12.076769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:12.079004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:12.079458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b3048950-d1a8-46f8-a6b0-05b793d2b927 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.199993 Sep 07 13:11:12.080034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 351/706] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:11 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:13.124117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:13.125225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:13.135465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.136063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.136487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.137118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.137573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.138170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.310383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.322309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.324997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.327119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bf767def-c739-4896-918d-6fe1e5e26d91 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.209336 Sep 07 13:11:13.328058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 356/707] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:13 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:14.365226 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:14.365895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:14.374014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.374507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.375016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.375766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.376227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.376649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.776194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.785018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.786468 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.787634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9dc865d9-ac95-4bd6-b8aa-b40f140a750f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.426716 Sep 07 13:11:14.788228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 352/708] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:14 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:15.816513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:15.817183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:15.824929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.825431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.825909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:15.826658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.827117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.827572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:15.830884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:16.072500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.081657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.083156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.084354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d5d8a33b-f46f-4f27-8d97-8051756b33e3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1741 microversion: 2.20 time: 0.272340 Sep 07 13:11:16.084939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 357/709] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:15 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:17.111805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:17.112648 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:17.119956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.120905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.120905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:17.121766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.122061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.122479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:17.363980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:17.373226 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:17.374743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:17.375962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-981f5aaa-408b-4e4e-94b3-58f577c0e3bb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.268343 Sep 07 13:11:17.376746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 353/710] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:17 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:18.403295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:18.404282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:18.412250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:18.412861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:18.413451 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:18.414190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:18.414636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:18.415066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:18.567438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:18.581726 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:18.583809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:18.585538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-46093904-a652-4451-b746-e0d787e85f72 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.186210 Sep 07 13:11:18.586300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 358/711] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:18 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:19.616426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:19.617157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:19.624522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:19.625025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:19.625459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:19.626322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:19.626822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:19.627304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:19.789605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:19.800326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:19.801906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:19.803148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c254b30b-93db-45ea-af91-201db5f7574f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.190784 Sep 07 13:11:19.803707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 354/712] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:19 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:20.834968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:20.836092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:20.840350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:20.857147 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.857688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.858113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.858835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.859287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.859701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.006757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.018938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.020419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.021703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-468799bc-89fa-4872-b0ad-69b91d332990 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.194062 Sep 07 13:11:21.022955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 359/713] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:20 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:22.063613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:22.064284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:22.071215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.071702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.072348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.073061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.073514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.073956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.216098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.225177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.226622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.227788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a21b91d2-1edc-4e0f-8242-14dc97ce97b7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.168228 Sep 07 13:11:22.228481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 355/714] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:22 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:22.839371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:22.856587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.856587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.864254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.877086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] Creating event network-vif-unplugged:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:11:22.887624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-cda45566-f98e-4649-ac84-434cfd39b27f req-da1d145d-8cd7-4bde-9bf5-0dd0913bb7d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053672 Sep 07 13:11:22.889837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 360/715] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:23.256996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:23.258065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:23.266740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.267240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.267685 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.268527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.268994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.269423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.487318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.501272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.503762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.505553 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca3f2a8b-a65c-4ec2-a800-3844e133c2e6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.254700 Sep 07 13:11:23.506494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 356/716] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:23 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:24.547159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:24.548055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:24.555424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.555910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.556375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.557253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.557737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.558161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.767999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.777333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.779043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.780617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa04fb3b-99ef-4f0c-9130-bab5aad7fa1b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1723 microversion: 2.20 time: 0.239783 Sep 07 13:11:24.781200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 361/717] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:24 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:25.290846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-356420362", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "networks": [{"uuid": "3defdac7-549c-4f2b-9796-6cb90bc141ef"}]}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:25.372372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] validate_networks() for [('3defdac7-549c-4f2b-9796-6cb90bc141ef', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:11:25.812240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:25.813713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:25.827564 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.828385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.829171 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.830545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.831351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.832089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.936001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:11:25.936361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:11:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef (ip 10.222.0.17) !!! Sep 07 13:11:26.060144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.064136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:11:26.064838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:11:26.065296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:11:26.065734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:11:26.066148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:11:26.071405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.073433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.075307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3d808ea3-a835-4baf-a16f-5ba19945de58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1666 microversion: 2.20 time: 0.271164 Sep 07 13:11:26.076057 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 362/718] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:25 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1666 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:26.076858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.077425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.077973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.078962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.079439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.079922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.099261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Getting quotas for project 73afbf716079452ba1deb906dbdce949. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:11:26.103213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ba8e1e5-283e-4b6d-b693-a185f7c82f96"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:26.104339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Getting quotas for user b22dd3b0461747688993851ccf4e66d0 and project 73afbf716079452ba1deb906dbdce949. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:11:26.105682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.112123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.112623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.113060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.113805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.114272 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.114691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.118257 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:11:26.121327 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:11:26.173066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7d311030-a147-4697-97eb-2c498c8b9ab9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886773 Sep 07 13:11:26.173630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 357/719] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:11:26.187680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4c07a2bf-9223-49cd-bac3-84ec87e2d1aa tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:26.188309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4c07a2bf-9223-49cd-bac3-84ec87e2d1aa tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.254191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4c07a2bf-9223-49cd-bac3-84ec87e2d1aa tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.261987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4c07a2bf-9223-49cd-bac3-84ec87e2d1aa tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1218 microversion: 2.1 time: 0.080725 Sep 07 13:11:26.262958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 358/720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:26 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:26.519629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b2f0c367-b6ed-427d-9156-4f75b7596f84 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.420338 Sep 07 13:11:26.520628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 363/721] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Sep 7 13:11:26 2022] POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 188 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:11:26.699314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:26.700010 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.707008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.707801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.708488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.709460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.710107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.710706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.790402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120818) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:11:26.909824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05e2c1e2-9ea0-4fdf-a5a9-580f838e6be4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/action" status: 202 len: 0 microversion: 2.20 time: 0.214383 Sep 07 13:11:26.911043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 359/722] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 13:11:26 2022] POST /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:11:26.926666 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:26.927601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.939309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.940201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.940879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.942004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.942641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.943270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.181710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.216060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.216060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.218186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-37f6766e-f1ff-4920-8890-a407121e2471 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1752 microversion: 2.20 time: 0.297294 Sep 07 13:11:27.218936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 364/723] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:26 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:27.286047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:27.286960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:27.295522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.296008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.296653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.297561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.298093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.298517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.406373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.415567 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-25f3068a-203f-43cc-9a62-5b0309278019 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1222 microversion: 2.1 time: 0.133541 Sep 07 13:11:27.416351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 360/724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:27 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:28.248177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.250126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.267785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.268394 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.268838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.269896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.270613 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.271164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.446298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.447800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.456506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.457334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.458013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.459255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.460652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.461108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.501172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.521308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.524618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.537078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0c7d3f82-e799-47e4-8420-5948bd2306c8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1752 microversion: 2.20 time: 0.292989 Sep 07 13:11:28.540257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 365/725] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1752 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:28.627835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.655205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-af9fd55e-9828-4884-b5f1-b1d04c0b1d62 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1278 microversion: 2.1 time: 0.214801 Sep 07 13:11:28.658769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 361/726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:29.574774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.575943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.587209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.588017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.589610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.590943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.591784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.592587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.691910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.692612 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.701472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.703286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.703787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.704763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.705620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.707218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.798847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.812817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.814789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.815992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa424f3c-64c4-4301-8ccf-3e5e189a6b5b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1754 microversion: 2.20 time: 0.249500 Sep 07 13:11:29.826439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 366/727] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1754 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:29.952690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.967701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9cb93ae7-11f6-4ffd-88a0-d8b8744f7620 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.280191 Sep 07 13:11:29.968401 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 362/728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:30.644504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b282d175-83fa-49ad-841b-010cfd1eb377", "tag": "e319c1cb-414a-460c-85d8-5c4c859cc4ec"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:30.669086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.669908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.670838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.687252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] Creating event network-changed:e319c1cb-414a-460c-85d8-5c4c859cc4ec for instance b282d175-83fa-49ad-841b-010cfd1eb377 on hv-cinder-85331 Sep 07 13:11:30.695316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-978217e7-8db1-43b5-bd3c-24138f359443 req-8e762502-e5ca-499d-8b4f-141c2fe0b4ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059486 Sep 07 13:11:30.696807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 367/729] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:30.854925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:30.855554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:30.862487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.862979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.863556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.864963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.865908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.866669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.996302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:30.997047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:31.004319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.004807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.005242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.005976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.006427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.006852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.022157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.032561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.034209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.035273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e31261a5-ccf7-482b-bfb1-0ad5825b5f58 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.184654 Sep 07 13:11:31.035880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 363/730] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:30 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:31.165454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.174330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-983cbb52-c150-4c8a-b711-d466537c685f tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.183955 Sep 07 13:11:31.175204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 368/731] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:30 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:32.069048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:32.070328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:32.096495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.097355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.098038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.098895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.099468 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.100201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.211935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:32.214586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:32.231150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.233087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.234188 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.236294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.237132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.237949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.360897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.376885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.381877 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.385550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2e286ab9-831e-406f-b64b-70579b32b9ec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.323567 Sep 07 13:11:32.400286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 364/732] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:32 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:32.515258 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.529971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a380b307-d69e-4346-b826-cbef4a752819 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.334637 Sep 07 13:11:32.530905 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 369/733] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:32 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:33.434074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.435438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.442657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.443154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.443586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.444293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.444782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.445214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.566769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.567378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.575506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.575866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.576297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.577063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.577718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.578170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.626999 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.636981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.645865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.645865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0856f365-7343-4f2b-8c9d-b00fcabbf919 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.209722 Sep 07 13:11:33.645865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 365/734] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:33.738977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.744989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d8fb7bbd-3234-43fa-b6cf-a331733287b1 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.183136 Sep 07 13:11:33.745523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 370/735] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:34.669305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:34.670198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:34.673538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:11:34.673955 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Wed Sep 7 13:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef (ip 10.222.0.17) !!! Sep 07 13:11:34.690414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.701136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.702204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.703759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.704472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.705269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.773305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:34.775959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:34.795633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.796183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.796619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.797361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.797852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.798401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.895960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.907976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.909457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.910724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5ced164a-6c5e-4242-bde9-14ab122c17ba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.247437 Sep 07 13:11:34.911525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 366/736] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:34 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:35.001144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:35.010103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dadb2d00-7f2d-418c-9fc8-271f1ebca074 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.241890 Sep 07 13:11:35.011471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 371/737] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:34 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:36.044713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:36.050456 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:36.057082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.057909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.058628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.059815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.060568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.061720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.086816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:36.090092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:36.132869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:36.134076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:36.144646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.145534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.146534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.147599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.148509 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.149146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.259504 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:36.290086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.305424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-957064bc-9f4f-4d1e-b3eb-4a344f69cee9 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.266858 Sep 07 13:11:36.306356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 372/738] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:36 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:36.372256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.386174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.389156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.390154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8c427b07-5824-44ac-a2f7-280bdcf5d655 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.443172 Sep 07 13:11:36.390778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 367/739] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:35 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:37.339598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:37.340380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:37.351111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.352388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.352965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.353781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.354324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.354761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.420714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:37.421517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:37.431631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.432488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.433077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.434076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.434696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.435259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.596091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.606276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7ae3d273-5fa8-4ded-bc14-0bcd34a46588 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.270619 Sep 07 13:11:37.607064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 373/740] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:37 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:37.658229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.668824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.670552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.671891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5d28198b-eab4-4c34-a127-c440337ef8cf tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.257332 Sep 07 13:11:37.672708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 368/741] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:37 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:38.641119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:38.641910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:38.649325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.650021 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.650667 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.652098 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.652701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.653179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.701075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:38.701883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:38.709525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.710153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.710816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.711741 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.712526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.713312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.717153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:38.860827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.874190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-710d8883-286c-4dc3-9322-9de98ab69025 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.236966 Sep 07 13:11:38.874817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 374/742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:38 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:38.939285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.956339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.958788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.960844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b6e03112-0f6e-450b-bef0-a3a60d305352 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.264426 Sep 07 13:11:38.962056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 369/743] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:38 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:39.899636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:39.900578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:39.908266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.908770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.909207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.910255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.910726 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.911187 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.003411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:40.004242 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:40.006887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:40.014495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.015121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.015771 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.016720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.017198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.017624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.087673 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.103531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa5c34ac-b53d-4dd0-ba75-c0341d72f5e0 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.207543 Sep 07 13:11:40.105044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 375/744] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:39 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:40.212709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.222837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.224305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.225517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7e05b0c6-5d06-46f0-aeb6-7973fef1beec tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.226778 Sep 07 13:11:40.226138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 370/745] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:39 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:41.142843 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.143864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.154431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.155427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.156211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.157208 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.157750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.158359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.262378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.263505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.286820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.288798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.290445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.292669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.293802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.294292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.465173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.485054 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fedfa85c-48ac-4190-b4ed-722422094193 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.347883 Sep 07 13:11:41.495551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 376/746] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:41.616222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.631969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.634517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.636213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0a355ac5-8263-4ac1-ab9a-c3b8c76fd820 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.382499 Sep 07 13:11:41.636931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 371/747] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:42.533078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:42.535892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:42.547200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.548339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.549332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.550840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.551833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.552629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.678319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:42.679504 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:42.702112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.715801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.715801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.715801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.715801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.716531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.809521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:42.832262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7a00666f-3969-4a5b-b6ca-0d4fc421bc51 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.307361 Sep 07 13:11:42.834064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 377/748] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:42 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:43.026014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.045052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.047985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.050493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-39a5f589-77bb-4736-8de7-2854e6edbb83 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.380212 Sep 07 13:11:43.066508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 372/749] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:42 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:43.876708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:43.877381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:43.889228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.889967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.890413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.891220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.891749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.892246 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.099729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:44.101152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:44.121117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.126059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.126059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.126059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.126059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.126867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.205473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.221571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4afb39fc-647c-435e-a5cd-aa621b080e2e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.350241 Sep 07 13:11:44.242170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 378/750] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:43 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:44.475689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.502186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.505554 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.508154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-51a3d1bf-379c-413d-a13f-fb8d3b7d1f6e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.427007 Sep 07 13:11:44.509223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 373/751] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:44 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:44.599069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b282d175-83fa-49ad-841b-010cfd1eb377", "name": "network-vif-plugged", "status": "completed", "tag": "e319c1cb-414a-460c-85d8-5c4c859cc4ec"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:44.643227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.644115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.653691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.696715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] Creating event network-vif-plugged:e319c1cb-414a-460c-85d8-5c4c859cc4ec for instance b282d175-83fa-49ad-841b-010cfd1eb377 on hv-cinder-85331 Sep 07 13:11:44.714103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-d2fc19ed-5128-4bf1-97b7-1a5a4658351d req-d6e91ed8-2e04-45e5-a815-59623d46d73f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117644 Sep 07 13:11:44.716954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 379/752] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:45.273828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.274761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.284403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.285003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.285650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.286796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.287648 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.288150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.544180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.557118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-64e9a764-4de9-4096-b208-2e00ba80d653 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.288233 Sep 07 13:11:45.558522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 374/753] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:45.573842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.574952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.585295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.585833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.586298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.586996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.587643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.588210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.834635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.849062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.851939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.854351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f20e2369-3211-4206-bbea-cd0e6cb97161 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.289803 Sep 07 13:11:45.867156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 380/754] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:46.587801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:46.588794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:46.615721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.616667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.617516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.619303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.620519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.621344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.913505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:46.916209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:46.929634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.930501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.931284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.933359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.934220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.935310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.982261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.007096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8aef39a9-07ee-4d1a-b390-7382d8484622 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.423102 Sep 07 13:11:47.009293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 375/755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:46 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:47.255014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.283112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.285477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.286976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b2c93fa9-1b63-4ae3-b5d7-a6b4c5155766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.390874 Sep 07 13:11:47.287566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 381/756] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:46 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:48.065142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:48.066778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:48.078120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.079144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.080000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.081414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.082393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.083163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.327680 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:48.328703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:48.340446 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.341238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.341527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.342377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.342760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.343181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.344601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.361903 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05c1338a-eed4-4637-8a4a-46667ee4211a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.312272 Sep 07 13:11:48.363425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 376/757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:48 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:48.637802 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.653000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.656540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.658631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0a664247-542f-4ba5-b3ca-d425c53c22f8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.338257 Sep 07 13:11:48.673705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 382/758] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:48 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:49.429141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.439551 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:49.451218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.452072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.452840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.466466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.467364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.468342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.706433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.708828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:49.722102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.724048 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.725023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.726636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.727551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.728553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.731602 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:49.747189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1b53c7de-9b46-42cc-91ba-b77a44d32e3e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.337277 Sep 07 13:11:49.748232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 377/759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:49.963622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:49.985918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:49.989134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:49.992017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-744a7c7a-7f36-44d0-a0e6-511bace6d7d2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.292588 Sep 07 13:11:49.995463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 383/760] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:50.789544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:50.791993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:50.817878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:50.817878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:50.817878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:50.818659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:50.820246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:50.820246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.042296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:51.043412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:51.070937 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=50 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:51.083699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.088463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.089559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.090903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.099039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.099979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.155102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.174991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-49d81fcf-91ad-4e11-9ae6-01ef47d59dc7 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.392344 Sep 07 13:11:51.177050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 378/761] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:50 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:51.544694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.582294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.593550 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.595873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-479145af-0be5-4bba-be59-20c19624c510 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.560637 Sep 07 13:11:51.596919 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 384/762] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:52.225731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:52.226984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:52.238929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.239727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.240425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.241585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.242418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.243110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.487923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.497275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-411ea495-d58a-40b4-987f-5b8df6f6cc06 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.279425 Sep 07 13:11:52.498024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 379/763] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:52 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:52.651137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:52.652173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:52.662217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.662924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.663512 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.664466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.665118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.665803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.890822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.905041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.907098 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.908566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-008808f8-cac7-44c2-854d-50f0b416f30d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.264027 Sep 07 13:11:52.909502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 385/764] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:52 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:53.533564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:53.534712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:53.546749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.547587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.548365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.549651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.550601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.551292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.773733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:53.790114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-851a028c-49aa-47c3-b106-34916307a164 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.263772 Sep 07 13:11:53.791043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 380/765] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:53 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:53.947980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:53.948935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:53.961196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.962056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.962834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.964133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.965168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.966008 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.254413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:54.270710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:54.273134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:54.275248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0d4f0ab1-6b1d-49ee-9bf7-9d12308a1d1e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.333374 Sep 07 13:11:54.276205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 386/766] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:53 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:54.828162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:54.829420 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:54.841629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.842575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.843532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.845724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.855810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.856892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:55.220942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:55.233182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4ebf386e-1136-4f5a-8266-6500be96ec8a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.413020 Sep 07 13:11:55.234275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 381/767] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:54 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:55.318899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:55.320586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:55.330851 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:55.331490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:55.331967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:55.332897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:55.333393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:55.333913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:55.590466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:55.601045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:55.602759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:55.604378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-77f0bada-941d-4778-85a7-c73d5a13bb7f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.290112 Sep 07 13:11:55.605384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 387/768] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:55 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:56.273194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.274247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.290631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.291865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.292931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.294486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.295451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.296430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.660335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.661464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.695558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.696435 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.697202 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.698802 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.699824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.700735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.733273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.747745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5dc443da-116a-42a6-aba1-7a467f291c70 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.480940 Sep 07 13:11:56.748800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 382/769] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:56.936420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.960799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.964401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.966527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5e4a32aa-179d-48ff-b7b1-d5da58f3d018 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.313092 Sep 07 13:11:56.975845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 388/770] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:11:57.802564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:57.803853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:57.818277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:57.819440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:57.820513 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:57.822128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:57.822949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:57.823872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:58.026264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:58.028106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:58.045915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:58.046580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:58.047249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:58.048083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:58.048682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:58.049391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:58.073727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:58.100435 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8e8152e-c59e-4cbe-8704-814c7d217988 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.315913 Sep 07 13:11:58.101457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 383/771] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:57 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:58.283211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:58.287091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.299853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:58.301769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:58.302989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8db57fbe-ee09-4c7c-9137-9826863e013f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.284995 Sep 07 13:11:58.303709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 389/772] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:58 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:11:59.144277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:59.145367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:59.156057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:59.157175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:59.157966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:59.159248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:59.160103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:59.160878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:59.340738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:59.342043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:59.354592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:59.355603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:59.356418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:59.357829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:59.358946 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:59.359839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:59.436018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:59.455317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6af8c0cc-e4a6-4249-b86c-19b7f6f29925 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.317354 Sep 07 13:11:59.457795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 384/773] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:59 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:59.627557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:59.644245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:59.647238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:59.649367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5d89c187-4e5c-426d-b97e-cdee859b05ea tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.316253 Sep 07 13:11:59.650401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 390/774] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:11:59 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:00.497550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:00.498510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:00.511138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.512047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.512939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.514295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.515132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.515886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.700396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:00.702643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:00.714493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.714987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.715909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.717012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.718201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.719027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.775540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:00.786731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:00.800630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ec12f02-d25c-45de-a5a9-fc7e2f3ccccb tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.309866 Sep 07 13:12:00.801866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 385/775] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:00 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:00.972743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:00.988020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:00.989703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:00.990930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-93b40e83-db60-4de5-aec4-5b6b8583dfa3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.300689 Sep 07 13:12:00.991465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 391/776] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:00 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:01.837128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:01.838438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:01.852023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:01.852892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:01.853660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:01.855086 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:01.855963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:01.860494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:02.045218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:02.048278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:02.069217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:02.070330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:02.079198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:02.082495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:02.083735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:02.085240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:02.190156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:02.208141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aef7a6f9-9c0c-4252-af98-a8d677339960 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.377653 Sep 07 13:12:02.211726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 386/777] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:01 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:02.626652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:02.639041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:02.640689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:02.642242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-728f75f6-f0f0-430e-adf5-c3e2d6dbd1b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.606377 Sep 07 13:12:02.643105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 392/778] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:02 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:03.245287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:03.246763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:03.258837 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.259683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.260445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.261756 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.262557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.263324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.531050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:03.548304 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2b9e932b-3620-4645-8c29-285aade75397 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1318 microversion: 2.1 time: 0.307470 Sep 07 13:12:03.549448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 387/779] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:03 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:03.685661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:03.686821 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:03.699032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.699908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.700760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.702024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.702863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.703622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.921923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:03.938516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:03.941483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:03.943697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b8829b78-103b-4681-907b-f0a4c254b035 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.265690 Sep 07 13:12:03.944792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 393/780] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:03 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:04.593642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:04.593642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:04.603675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.604277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.604833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.605915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.606632 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.607251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.872659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:04.885947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ceeb43fc-dde0-4db9-b887-208aa0ee138e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1508 microversion: 2.1 time: 0.299624 Sep 07 13:12:04.888063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 388/781] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:04 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:04.934489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb222b8a-b135-4063-8739-fba0a3df17d5", "device": "/dev/sdb"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:04.941470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:04.955341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.956259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.956892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.957696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.958287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.958951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.984386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:04.986527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:05.002985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.004018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.004799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:05.006045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.006473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.006800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:05.251332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:05.260688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:05.262995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:05.264472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-30e9c750-028e-4338-8add-2741f6a7ffac tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.287587 Sep 07 13:12:05.265402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 389/782] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:04 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:12:05.414692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-143afc01-324c-4e8d-b92c-2ab1affd8e8b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "POST /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489289 Sep 07 13:12:05.420761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 394/783] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:12:04 2022] POST /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:06.298706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:06.299564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:06.311467 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:06.312268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:06.313069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:06.314352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:06.315207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:06.315943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:06.614230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:06.630530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:06.634177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:06.636574 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-947ccc9c-43eb-4f5d-9971-44a3978bff67 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.345941 Sep 07 13:12:06.637982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 390/784] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:06 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:07.700438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:07.700438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:07.711552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:07.712125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:07.712568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:07.713371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:07.713886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:07.714837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:07.927964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:07.939849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:07.941691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:07.943232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-43f1ff84-29de-4e00-b2bb-fc5dc47fa81d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.254261 Sep 07 13:12:07.944014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 395/785] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:07 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:08.977122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:08.978071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:08.988132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.989035 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.989882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:08.991209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.992051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.992822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:09.213723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:09.224699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:09.226378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:09.228250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9c8a7ced-f2a6-4c73-a9d9-82ac5c9f4766 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.256975 Sep 07 13:12:09.229185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 391/786] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:08 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:10.277659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:10.280071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:10.291757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.292934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.293345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.294656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.295481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.297494 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.532773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:10.545059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:10.546972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:10.548618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-04b9810e-5d6e-4510-9f5e-7c5554ebc68f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.278225 Sep 07 13:12:10.549557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 396/787] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:10 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:11.584880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:11.585981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:11.590408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=44 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:11.600619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.601512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.602144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:11.602886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.603362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.603795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:11.817442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:11.834928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:11.836668 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:11.838098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-03da2983-a8d4-4379-851a-fcf7340c1123 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.261127 Sep 07 13:12:11.838806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 392/788] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:11 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:12.883892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:12.884957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:12.896720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:12.897535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:12.898292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:12.899473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:12.900255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:12.900974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:13.095518 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:13.112661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:13.114286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:13.115522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ce1532a9-0c2e-41e3-a9d1-5ff058130a8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.238758 Sep 07 13:12:13.116127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 397/789] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:12 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:13.607357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "name": "network-vif-plugged", "status": "completed", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:13.625100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:13.625948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:13.626689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:13.642809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] Creating event network-vif-plugged:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:12:13.652563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c776a79e-84f9-4085-ab5b-b30fcb7747a2 req-a0a32981-59ae-4beb-a4e5-1bf2fa886bc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354645 Sep 07 13:12:13.653550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 393/790] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:14.157805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:14.158604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:14.170620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:14.171535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:14.172355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:14.173716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:14.174585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:14.175251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:14.436976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:14.457842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:14.461923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:14.465079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0aade676-f319-43ca-810d-c6caa0de11eb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.313438 Sep 07 13:12:14.467247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 398/791] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:14 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:15.521294 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:15.522657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:15.534961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.535800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.536594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:15.537991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.538853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.539625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:15.775146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:15.791562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:15.794515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:15.796599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-432e3b94-4056-4a06-a153-52566303e517 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.283527 Sep 07 13:12:15.797514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 394/792] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:15 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:16.840248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:16.841453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:16.853269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:16.854193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:16.855019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:16.856349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:16.857181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:16.857969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:17.117164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:17.130333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:17.132517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:17.134734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-da47fc50-cbe8-4430-a79b-44985cc144f7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.302284 Sep 07 13:12:17.135628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 399/793] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:16 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:18.183677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:18.184709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:18.193944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:18.194711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:18.195462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:18.196488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:18.197329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:18.198172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:18.422671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:18.440315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:18.443708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:18.446042 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05390442-6d83-446a-bae4-117d8328b0ad tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.269323 Sep 07 13:12:18.447058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 395/794] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:18 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:19.491282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:19.492333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:19.505591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:19.506334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:19.507082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:19.508266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:19.509060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:19.509618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:19.732170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:19.747168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:19.749788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:19.751765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a4617867-96b4-4261-bc1a-6e072425354e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.264752 Sep 07 13:12:19.752696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 400/795] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:19 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:12:20.797455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:20.798477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:20.807301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:20.807792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:20.808217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:20.809036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:20.809809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:20.809970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.007087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:21.022509 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:21.025372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:21.027241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2b79ba1-2f65-4eac-81b2-6c319aab6c4e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.237219 Sep 07 13:12:21.028226 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 396/796] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:20 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:22.064669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:22.065532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:22.070387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=34 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:22.082021 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.082957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.083739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.085078 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.086550 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.087131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.366479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:22.389884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:22.392722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:22.394983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9121df66-54c1-4342-bb44-e18525718974 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.335337 Sep 07 13:12:22.397733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 401/797] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:22 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:23.437170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:23.438325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:23.450933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.451790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.452566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.453913 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.454751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.455505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.662879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.681075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.683941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.686159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-64a69853-f423-4aa5-a528-f9cf9a780288 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.256574 Sep 07 13:12:23.687727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 397/798] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:23 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:24.722789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:24.724025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:24.734090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.734586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.735285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.736527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.737336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.738157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.945136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.955387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.956844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.958349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d2d51a4a-82df-48cc-81fa-ed26a11571b8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.240069 Sep 07 13:12:24.964091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 402/799] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:24 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:12:25.989580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:25.990481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:26.000150 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.000956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.001716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.002783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.003465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.004073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.226921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:26.240693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:26.243640 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:26.245951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf104cff-9b27-4abb-88d9-8b2977dccb86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1810 microversion: 2.20 time: 0.260752 Sep 07 13:12:26.247318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 398/800] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:25 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:27.287134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:27.288192 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:27.298632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:27.299390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:27.300127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.301327 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:27.302238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:27.303018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.487299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.499578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.501074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.502354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e95babdf-9b6a-4ef8-a9be-910654750b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1797 microversion: 2.20 time: 0.221579 Sep 07 13:12:27.502957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 403/801] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:12:27 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1797 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:12:31.263623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:31.264522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:31.276107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:31.276982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:31.277862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:31.279204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:31.280022 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:31.280786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:31.538890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lazy-loading 'services' on Instance uuid b282d175-83fa-49ad-841b-010cfd1eb377 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:12:31.735599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c7fed88b-0da8-4a9e-9aa4-302ada609e19 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377/os-volume_attachments/fb222b8a-b135-4063-8739-fba0a3df17d5" status: 202 len: 0 microversion: 2.1 time: 0.477663 Sep 07 13:12:31.736710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 399/802] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:12:31 2022] DELETE /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377/os-volume_attachments/fb222b8a-b135-4063-8739-fba0a3df17d5 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:12:34.021453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:34.023259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:34.036463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.037342 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.038181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.039440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.040218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.040924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.050181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:34.084144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:12:34.231079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-62387d03-f2fe-470a-bb4c-4d61bd04cd8e tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 204 len: 0 microversion: 2.1 time: 0.215765 Sep 07 13:12:34.231709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 404/803] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:12:34 2022] DELETE /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:12:34.244406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:34.245404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:34.257697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.258394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.258968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.259783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.260458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.261107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.264917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:34.463760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:34.478139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5699d89d-4eb6-4114-b3a0-fcd34bbfe2c6 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1514 microversion: 2.1 time: 0.239086 Sep 07 13:12:34.479233 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 400/804] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:34 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:35.521854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:35.523138 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:35.534657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:35.535527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:35.536302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:35.537534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:35.538356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:35.538865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:35.745793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:35.755779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-221b24a7-6ae4-4bc2-92c6-d03222342873 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1514 microversion: 2.1 time: 0.241419 Sep 07 13:12:35.756380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 405/805] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:35 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:36.781880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:36.782736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:36.797966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.798656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.799171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:36.806053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.806053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.806053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:36.977909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:36.993661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e956b032-a3da-47f0-bfef-f457cc752689 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1514 microversion: 2.1 time: 0.216810 Sep 07 13:12:36.994761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 401/806] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:36 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:38.022521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:38.023888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:38.034962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.035469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.035913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.036963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.037433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.038350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.295404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:38.326647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-18d39c2b-3842-4719-9b1a-1bcd7838e299 tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1514 microversion: 2.1 time: 0.308181 Sep 07 13:12:38.330340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 406/807] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:38 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:38.505121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b282d175-83fa-49ad-841b-010cfd1eb377", "name": "network-vif-deleted", "tag": "e319c1cb-414a-460c-85d8-5c4c859cc4ec"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:38.523770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.526088 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.526883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.554001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] Creating event network-vif-deleted:e319c1cb-414a-460c-85d8-5c4c859cc4ec for instance b282d175-83fa-49ad-841b-010cfd1eb377 on hv-cinder-85331 Sep 07 13:12:38.562485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-32126a80-8359-47fd-bc02-51079fc0e476 req-0b63b7a7-303f-40f6-b97f-5ac4929f1284 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149441 Sep 07 13:12:38.563167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 402/808] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:39.365383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:39.367864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:39.383077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.384236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.385067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.386432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.387724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.388510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.443274 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.444191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.444965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.446053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lazy-loading 'fault' on Instance uuid b282d175-83fa-49ad-841b-010cfd1eb377 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:12:39.528572 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22dd3b0461747688993851ccf4e66d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afbf716079452ba1deb906dbdce949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:39.543783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-24269590-140e-4d31-8fbd-e68aab364e3a tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 200 len: 1308 microversion: 2.1 time: 0.185306 Sep 07 13:12:39.544849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 407/809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:39 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:40.589484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:40.590230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] [instance: b282d175-83fa-49ad-841b-010cfd1eb377] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:40.597401 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:40.598206 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:40.598730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.599800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:40.599800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:40.600214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.618417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] HTTP exception thrown: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Request method failure captured: Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 HTTP/1.1 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJfrYn4sFUIBjaC0gzksEEsUPHW26d9JjIBza3jO0N9-HRVP3GKm9Fc-6MzQGpD_2oAhFpzeh3PzHrnBuEBErUPC0WCs6tqIY7QnJDnXFnnoQ-B3SP-BwxA6gCqYoSmh6HtsUU9v8OnUqU71Mk_GGHPJ5zKX7EuT_4MJwGr7ei7ap1U Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 73afbf716079452ba1deb906dbdce949 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:12:40.620114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73afbf716079452ba1deb906dbdce949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_73afbf716079452ba1deb906dbdce949", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/73afbf716079452ba1deb906dbdce949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/73afbf716079452ba1deb906dbdce949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 73afbf716079452ba1deb906dbdce949 Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942519821 Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesSnapshotTestJSON-942519821-project Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: b22dd3b0461747688993851ccf4e66d0 Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesSnapshotTestJSON-942519821-project Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. Sep 07 13:12:40.622824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'b282d175-83fa-49ad-841b-010cfd1eb377'} Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:12:40.624119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. Sep 07 13:12:40.626018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:12:40.628109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] Returning 404 to user: Instance b282d175-83fa-49ad-841b-010cfd1eb377 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:12:40.628109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e6fb90ad-a122-439a-95f4-734225e9644b tempest-VolumesSnapshotTestJSON-942519821 tempest-VolumesSnapshotTestJSON-942519821-project] 10.222.0.17 "GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377" status: 404 len: 111 microversion: 2.1 time: 0.039650 Sep 07 13:12:40.628109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 403/810] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:40 2022] GET /compute/v2.1/servers/b282d175-83fa-49ad-841b-010cfd1eb377 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:53.495218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:53.498010 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:53.501219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:53.502046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:53.508602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.509228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.509699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:53.510853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.511425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.511877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.788577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6339a61a-ba7a-406a-b21f-65a7461c4ca1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action" status: 200 len: 36434 microversion: 2.1 time: 4.297461 Sep 07 13:12:57.789560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 408/811] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:12:53 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action => generated 36434 bytes in 4300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:12:58.265481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:58.266162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:58.268584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=23 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:58.269240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=15 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:58.275963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.276455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.276885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.277587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.278065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.278476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.308918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-95447257-6737-4e94-8399-1b406c8a59a6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/ips" status: 200 len: 145 microversion: 2.1 time: 0.047565 Sep 07 13:12:58.309467 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 404/812] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:12:58 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:02.808084 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d42db35-c89f-4436-a163-e7d6b0650df1"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:02.812856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:02.828148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:02.828946 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:02.829747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:02.830918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:02.831703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:02.832434 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:03.194668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5fab1475-5097-469c-bd07-61a65ea07d35 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398780 Sep 07 13:13:03.195538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 409/813] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:02 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:11.995473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:12.001514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:12.002766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:12.013615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.015066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.015804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.111858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Going to try to stop instance {{(pid=120818) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:13:12.171608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-148cf823-1986-447f-b1ba-e6cc3d39b15b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action" status: 202 len: 0 microversion: 2.1 time: 0.181499 Sep 07 13:13:12.172236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 405/814] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:11 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:13:12.189618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:12.190706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:12.206537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.207877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.208654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.209980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.210665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.211465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.425168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:12.434838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-13749cef-b788-4b19-9c63-7a744570e283 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.254128 Sep 07 13:13:12.435404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 410/815] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:12 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:13.460381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:13.461152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:13.468328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.468824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.469263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.470122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.470462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.470891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.669039 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:13.678717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-24a45f0e-f476-445c-bec1-ccd252cca0f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.223212 Sep 07 13:13:13.679317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 406/816] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:13 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:14.716018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:14.717080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:14.727611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.728383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.729074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.730476 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.731253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.732150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.912921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:14.922289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-76db2391-a918-408e-ab5a-3e0243293963 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.213086 Sep 07 13:13:14.922818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 411/817] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:14 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:15.947309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:15.948220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:15.956671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:15.957233 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:15.957697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:15.958426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:15.958882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:15.959306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.110371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:16.124540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1ab60b93-45a6-41a9-a5ff-c72ef0eb356b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.181154 Sep 07 13:13:16.125137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 407/818] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:15 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:17.149224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:17.149887 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:17.159135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.159628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.160287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.161506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.162092 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.162522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.332139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:17.340929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cd75d64a-f0dd-4038-b449-52c4bf1213ca tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.195837 Sep 07 13:13:17.341513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 412/819] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:17 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:18.058571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d465e147-4622-473c-821b-999b3c9bfc10"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:18.061916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:18.070900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.071284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.071740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.072445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.072907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.073323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.365111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:18.365852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:18.368450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:13:18.368627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b (ip 10.222.0.17) !!! Sep 07 13:13:18.373927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4b38b17c-6e2d-4c35-88be-4a3863cdc64f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564462 Sep 07 13:13:18.383398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 408/820] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:17 2022] POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:18.391479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.392015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.392392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.393318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.393868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.394711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.564044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:18.572989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0a74a7f7-3131-4b57-9d76-86d1c90d2a89 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.212210 Sep 07 13:13:18.573585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 413/821] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:18 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:19.598167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:19.598967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:19.605290 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:19.606101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:19.606546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:19.606864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:19.607408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:19.607833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:19.762896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:19.772134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3bb05b4f-7720-4c97-b6f0-577c92a3e16d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.178853 Sep 07 13:13:19.772709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 409/822] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:19 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:20.801714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:20.802430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:20.809660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.810255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.810694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.811468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.812129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.812561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.958411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:20.967598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-296fdd63-3e6f-41dd-8b4d-9a3cff133ee4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.169782 Sep 07 13:13:20.968455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 414/823] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:20 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:21.992209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:21.993061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:22.003108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.003789 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.004514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.005532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.006146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.006863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.240392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:22.252380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f86e799b-5bb8-4dbb-87d7-0c7e5047d8eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1723 microversion: 2.1 time: 0.263787 Sep 07 13:13:22.252916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 410/824] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:21 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:23.290594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:23.291648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:23.301414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.301930 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.302375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.303115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.303575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.304006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.482819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:23.491923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-904c7df9-eb5d-45dc-b71e-77ce9768d36c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1700 microversion: 2.1 time: 0.208322 Sep 07 13:13:23.492589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 415/825] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:23 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1700 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:23.516078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:23.523343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.523835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.524262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.555578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Going to try to start instance {{(pid=120818) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:13:23.623121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cb7455c8-deea-44f4-ad47-fa1781e3d1ef tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action" status: 202 len: 0 microversion: 2.1 time: 0.110560 Sep 07 13:13:23.624692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 411/826] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:23 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:13:23.641074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:23.641074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:23.650243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=17 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:23.654255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.655504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.656387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.657757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.658832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.659804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.671618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:23.891233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:23.910319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-391125ed-5e5e-482d-a6b8-3f322a11e940 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1709 microversion: 2.1 time: 0.278349 Sep 07 13:13:23.911369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 416/827] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:23 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1709 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:24.943667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:24.944914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:24.956410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:24.957274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:24.957982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:24.959254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:24.959488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:24.959921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.116440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:25.125713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-63ba7714-8f7b-447e-88ea-36a643cd28dc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1709 microversion: 2.1 time: 0.188754 Sep 07 13:13:25.126322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 412/828] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:24 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.145713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:26.152807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.153658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.156500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.165353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.165978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.166430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.166590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.167278 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.167430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.167906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.168089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.168454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.169275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.170134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.171878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.216913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'flavor' on Instance uuid 528dbaca-73da-4486-8574-ab5c8399150a {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:26.380392 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:26.392373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6af677c4-712f-4feb-a7b1-7a0d791a636a tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/action" status: 200 len: 32 microversion: 2.1 time: 0.250785 Sep 07 13:13:26.398037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 417/829] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:26 2022] POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:13:26.398264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d08aa9d8-ced4-4db5-9bb3-cd6358e1da00 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1709 microversion: 2.1 time: 0.246503 Sep 07 13:13:26.398264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 413/830] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1709 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.408548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.409448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.417556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.418247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.418785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.419675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.420231 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.420815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.620544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:26.635626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-238b8fb9-6362-4632-8738-4753c5d9797f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.232340 Sep 07 13:13:26.636362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 418/831] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:27.427661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:27.428652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:27.438646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.439540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.440394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.441658 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.442524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.443280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.668289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:27.669248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:27.681108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.682023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.682780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.684280 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.684929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.685589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.727871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:27.741374 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-19869d90-f9e3-46e7-96a1-8a824d6a0636 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1713 microversion: 2.1 time: 0.321602 Sep 07 13:13:27.742654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 414/832] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:27 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1713 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:27.902255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:27.918600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d7a35f36-512c-41b4-882f-43fdccdac66f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.256788 Sep 07 13:13:27.919607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 419/833] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:27 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:28.956229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:28.957195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:28.964637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:28.965184 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:28.965833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:28.966625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:28.967103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:28.967729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:29.151905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:29.161720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-33333afb-3ff2-4df8-b169-cf693b4b0077 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.210055 Sep 07 13:13:29.162672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 415/834] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:28 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:30.199907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:30.200875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:30.210535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:30.211405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:30.212155 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:30.213302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:30.214100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:30.214864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:30.411653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:30.426488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e7819c30-1c30-4dd3-9a2e-77660d2e3f5f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.233759 Sep 07 13:13:30.427466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 420/835] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:30 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:31.470247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:31.471367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:31.485744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.485744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.485744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.487146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.487724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.488448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.668003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:31.682916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-501a2e8f-08f5-4062-a77e-41bdb8230406 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.219855 Sep 07 13:13:31.683840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 416/836] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:31 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:32.715730 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:32.716413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:32.723392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.723881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.724320 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.725030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.725480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.725925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.911688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:32.922080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1dbde4b4-549f-4e62-af59-5ece9daafcff tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.212229 Sep 07 13:13:32.923067 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 421/837] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:32 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:33.951684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:33.953547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:33.974803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.975644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.976332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.977493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.978338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.979092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.148368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:34.159274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c6688815-4473-4436-86dc-f167dea133fb tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.214720 Sep 07 13:13:34.160175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 417/838] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:33 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:35.188986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:35.189942 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:35.198606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.199190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.199629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.200478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.200814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.201242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.389050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:35.399909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-56b5b621-5cf3-4339-8bce-29b22c6385b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.218204 Sep 07 13:13:35.400788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 422/839] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:35 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:36.437190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:36.439247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:36.452195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:36.453094 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:36.453935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:36.455268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:36.456111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:36.456919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:36.465196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:36.636959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:36.652760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-99a2f40c-571b-46e4-9706-b0166cde55f0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.223221 Sep 07 13:13:36.653833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 418/840] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:36 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:37.691312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:37.692177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:37.699735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.700295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:37.700771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.701546 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.702209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:37.702772 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.935664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:37.949533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-897177c6-ac23-4c3b-b13a-2c035ae13789 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.263642 Sep 07 13:13:37.950218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 423/841] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:37 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:38.980968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:38.982104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:38.992627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.993163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.994008 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.994861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.995344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.995810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.172419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:39.182489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2563c5ab-2c80-4461-b5ef-c4f1cb913f1d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.208888 Sep 07 13:13:39.183216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 419/842] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:38 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:40.215318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:40.216452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:40.226417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.227091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.227813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.229105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.230001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.230922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.477126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:40.497424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9aa87953-7f83-4435-b760-5c5612df5f86 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.289443 Sep 07 13:13:40.497424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 424/843] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:40 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:41.538783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:41.539799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:41.549465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.550285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.550976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.552549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.553293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.554068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.760935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:41.772831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7ad60a0e-0055-45fe-8341-b7ebc820d501 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1735 microversion: 2.1 time: 0.239046 Sep 07 13:13:41.773526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 420/844] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:41 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:42.808748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:42.809880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:42.820696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.821426 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.822289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.823554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.824264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.824929 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.040275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:43.052219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4517ec1c-e189-47ea-96a9-69f6ae66b1c4 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1715 microversion: 2.1 time: 0.250658 Sep 07 13:13:43.053233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 425/845] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:42 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1715 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:43.157541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.158586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.161287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=33 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:43.170031 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.170840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.171647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.172646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.173215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.173834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.344103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] HTTP exception thrown: Cannot 'detach_volume' instance 528dbaca-73da-4486-8574-ab5c8399150a while it is in vm_state rescued Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Request method failure captured: Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments/d465e147-4622-473c-821b-999b3c9bfc10 HTTP/1.1 Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdNYMn96FfG87ejrN3gZhTeySUroTnqKfMThkVCKaxgitJxut8GKAznk9hHfeRez9ivmWqQdH_2aioZNLNl5zDfcleKvIleAAgYNdM5_zqbmHl4DTW0pLKS6QEhjGzWSxuctpXSyaetu0e3jF1VX35lmS8mkZ3AvdYrthqnIH0gphY Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:13:43.347215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9bb55accaa9046d99253a42a3154fe1b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 3cad6d025da54eb29d09fd2a2888c844 Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:13:43.349783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Cannot 'detach_volume' instance 528dbaca-73da-4486-8574-ab5c8399150a while it is in vm_state rescued Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'server_id': '528dbaca-73da-4486-8574-ab5c8399150a', 'id': 'd465e147-4622-473c-821b-999b3c9bfc10'} Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 528dbaca-73da-4486-8574-ab5c8399150a in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:43.351381 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 528dbaca-73da-4486-8574-ab5c8399150a while it is in vm_state rescued Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 528dbaca-73da-4486-8574-ab5c8399150a while it is in vm_state rescued Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:13:43.354084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Returning 409 to user: Cannot 'detach_volume' instance 528dbaca-73da-4486-8574-ab5c8399150a while it is in vm_state rescued {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:43.356689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-320b7761-7b85-43e9-a741-c919ff149be7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments/d465e147-4622-473c-821b-999b3c9bfc10" status: 409 len: 152 microversion: 2.1 time: 0.197795 Sep 07 13:13:43.356689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 421/846] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:13:43 2022] DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments/d465e147-4622-473c-821b-999b3c9bfc10 => generated 152 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:13:43.366038 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:43.366829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.378332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.379234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.380214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.382068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.382399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.383192 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.529927 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ffcae503-568d-4a7c-b9c5-f5bf22f26f0d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/action" status: 202 len: 0 microversion: 2.1 time: 0.171072 Sep 07 13:13:43.531613 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 426/847] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:43 2022] POST /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:13:43.546373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.547400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.557553 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.558356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.558621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.559747 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.560223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.561287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.917576 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:43.934301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-20bbaf7f-1600-4ad5-8a4c-e734f28b79fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1723 microversion: 2.1 time: 0.394600 Sep 07 13:13:43.935523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 422/848] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:43 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:44.967616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:44.969245 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:44.981341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.982268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.982979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.983529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.984326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.985090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.179595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.186248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.198535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.199483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.200125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.201052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.201724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.202607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.250492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d39052a2-a13c-424e-ba7a-b48f2b317ac1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/ips" status: 200 len: 150 microversion: 2.1 time: 0.304709 Sep 07 13:13:45.251558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 427/849] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:13:44 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/ips => generated 150 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:45.259712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:45.277183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a73383f1-fb3e-4de9-8393-ec23adf1f617"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:45.277183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.282947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.282947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.287444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.287726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-203e8f42-d7ad-4bf7-9479-5281d7517715 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1723 microversion: 2.1 time: 0.323635 Sep 07 13:13:45.288217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.288362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 423/850] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:44 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:45.288689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.288689 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.320632 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.321549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.333271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.337338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.338163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.342273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.346048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.349418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.403619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e87b6169-7bc1-4573-92aa-fa3f3fb01073 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments/3ba8e1e5-283e-4b6d-b693-a185f7c82f96" status: 200 len: 194 microversion: 2.20 time: 0.097575 Sep 07 13:13:45.404621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 424/851] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments/3ba8e1e5-283e-4b6d-b693-a185f7c82f96 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:13:45.497491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: POST /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/os-volume_attachments HTTP/1.1 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 74 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:13:45.500045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {"volumeAttachment": {"volumeId": "a73383f1-fb3e-4de9-8393-ec23adf1f617"}} Sep 07 13:13:45.503297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'server_id': '557046c4-53f5-4652-abb6-20ae0c1143f0', 'body': {'volumeAttachment': {'volumeId': 'a73383f1-fb3e-4de9-8393-ec23adf1f617'}}} Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:45.505080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:45.507791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 400 to user: Invalid volume: volume a73383f1-fb3e-4de9-8393-ec23adf1f617 is already attached to instances: 220b5e26-01bc-4cee-83b3-abe0a93330b4 {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3a5a756b-1f56-440c-ac3b-22a32b260d88 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.239575 Sep 07 13:13:45.510647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 428/852] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:45 2022] POST /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0/os-volume_attachments => generated 174 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:13:45.518024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.518813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.530027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.530938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.532044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.532959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.533757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.534699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.562699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.563627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.576637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.577524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.578385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.579749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.580591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.581353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.588603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:13:45.747643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d459ba2b-c860-44b1-8766-1e6dd0343764 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 204 len: 0 microversion: 2.1 time: 0.235447 Sep 07 13:13:45.748311 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 425/853] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:13:45 2022] DELETE /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:13:45.758289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lazy-loading 'services' on Instance uuid cd384fa3-24c0-47a6-8dc5-f6ad179994ef {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:45.762788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:45.764239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.765960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.777225 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.778248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.778889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.780166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.781166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.781891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.903832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1cb6c1e8-c792-4fd5-b9e1-8acaa46417f4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments/3ba8e1e5-283e-4b6d-b693-a185f7c82f96" status: 202 len: 0 microversion: 2.20 time: 0.354454 Sep 07 13:13:45.904922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 429/854] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Sep 7 13:13:45 2022] DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments/3ba8e1e5-283e-4b6d-b693-a185f7c82f96 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:13:45.933556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.941279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.947303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.947943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.948478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.949337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.949937 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.950472 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.015917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fb18d978-8ab7-4987-aa65-0688c4f55eb6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097469 Sep 07 13:13:46.016769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 430/855] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:13:46.027395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.048080 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4ed918e6-4650-4458-b0e8-2f67fa68843d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1682 microversion: 2.1 time: 0.291623 Sep 07 13:13:46.049178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 426/856] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:46.326250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:46.327212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:46.338323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.338980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.339739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.341359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.342141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.342720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.621542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.637610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d9c91322-d11e-443c-9341-6150ccc578f9 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1723 microversion: 2.1 time: 0.317249 Sep 07 13:13:46.638700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 431/857] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:46 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:47.038793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.041828 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.051165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.051946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.052667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.053813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.054980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.055740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.100972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.101769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.110980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-347d7eb8-f4ae-4411-9c34-fa967a8cece9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076728 Sep 07 13:13:47.111666 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 427/858] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:13:47.112980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.113910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.114701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.115991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.116844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.117618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.325291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:47.337094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-38b61f22-6118-4da8-be8a-0908b15cbf30 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1682 microversion: 2.1 time: 0.245091 Sep 07 13:13:47.338182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 432/859] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:47.683255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.684613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.695749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.696253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.696918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.698006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.698734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.699680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.937432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:47.950755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b67d147d-d5b0-4df1-80ce-6dbd0bed384f tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1723 microversion: 2.1 time: 0.275460 Sep 07 13:13:47.951729 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 428/860] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:48.131083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:48.133659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:48.142370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.142838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.143278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.144007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.144466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.144893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.197269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9d6323b5-3de9-4d00-ad00-1fac6977a0f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072289 Sep 07 13:13:48.198493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 433/861] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:48 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:13:48.378890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:48.380412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:48.397098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.398952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.400059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.402411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.403676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.405352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.621260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:48.631250 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bfc0a9a9-59ff-4376-8909-ab7e53be0192 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1682 microversion: 2.1 time: 0.261434 Sep 07 13:13:48.631953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 429/862] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:48 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:48.987977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:48.989077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:48.999640 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.000464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.001196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.002411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.003189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.003902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.231249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.235609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.248035 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.248880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.249278 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.250537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.251315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.252013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.253663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:49.266001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d7f55b2c-462c-41b6-9b53-712372b2dc67 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1729 microversion: 2.1 time: 0.285411 Sep 07 13:13:49.266961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 434/863] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:48 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:49.301051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.301983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.311118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.311889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.312526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.313470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.314137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.314615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4d458a51-840f-44b8-a33f-69d7d26d006f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095374 Sep 07 13:13:49.314980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.315711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 430/864] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:13:49.472673 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7c6ee659-4a85-4824-9f25-2120ba2c8708 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178650 Sep 07 13:13:49.473811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 435/865] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:49.659758 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.660864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.673414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.674333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.675178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.676473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.677281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.678032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.275871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:50.291433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1ac76931-f9e9-4fe0-8a26-a8b122c433fb tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1682 microversion: 2.1 time: 0.637911 Sep 07 13:13:50.301718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 431/866] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1682 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:50.338033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:50.342973 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:50.355156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.356073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.356857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.357821 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.358585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.359055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.423987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3b468397-531d-4082-9984-e8b0f0fec5a0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093132 Sep 07 13:13:50.425170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 436/867] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:50 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:13:51.360329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.361445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.370278 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.371071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.371746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.372992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.382264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.382264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.446522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.452926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.466228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.467063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.467849 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.469690 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.470565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.471439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.540418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2ae48ca4-d807-4775-ab35-ef690206358d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102693 Sep 07 13:13:51.542429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 437/868] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:13:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:51.685431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.686335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.698266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.699157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.699954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.701321 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.702184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.702990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.754033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:13:51.913986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8d758883-66fc-40ff-8770-3a4ed0bd7082 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 204 len: 0 microversion: 2.20 time: 0.234844 Sep 07 13:13:51.915049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 438/869] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 13:13:51 2022] DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 13:13:51.929952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.940813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.955023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.955954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.956748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.958112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.959115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.959793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.253896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.272863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.275921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.278087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f1317073-719b-4338-b488-4616900e3451 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.356183 Sep 07 13:13:52.279306 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 439/870] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:51 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:13:52.372728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.403483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b92f15ba-fbc3-4f91-8079-63793fbe903c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1682 microversion: 2.1 time: 1.048628 Sep 07 13:13:52.404531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 432/871] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:51 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1682 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:52.918972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:52.981873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.983418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.984753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.014167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] Creating event network-changed:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:13:53.027288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-9615fc58-0289-443f-abfc-8778e94559c8 req-2588535a-2926-4120-9fe8-c77b4c03e895 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114989 Sep 07 13:13:53.028523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 440/872] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:53.331959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:53.333882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:53.360458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.363833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.365076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.366939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.368082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.369196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.412148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:53.453493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:53.476213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:53.514794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.516517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.518296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.520252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.535571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.536336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.746649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:53.771554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-42cab5fa-f646-42b1-a9c8-75759833fb3a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1614 microversion: 2.1 time: 0.322024 Sep 07 13:13:53.774697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 441/873] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:53 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1614 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:54.186550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:54.207240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:54.223106 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:54.226534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9dc391cc-3e47-4ba4-9624-17fc3037b8c4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.906513 Sep 07 13:13:54.228625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 433/874] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:53 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:13:54.816760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:54.822135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:54.828375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:54.873544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.894449 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.895017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.896303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.898334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.921385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.071236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.091027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.091836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.092671 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'fault' on Instance uuid 557046c4-53f5-4652-abb6-20ae0c1143f0 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:55.160121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}, {"server_uuid": "557046c4-53f5-4652-abb6-20ae0c1143f0", "name": "network-vif-deleted", "tag": "2ba83860-5dc2-4073-8587-d6af429173cf"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:55.209902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.210792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.211580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.282664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Creating event network-changed:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:13:55.290383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] Creating event network-vif-deleted:2ba83860-5dc2-4073-8587-d6af429173cf for instance 557046c4-53f5-4652-abb6-20ae0c1143f0 on hv-cinder-85331 Sep 07 13:13:55.327344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-e8941c6c-6778-4341-af86-e82e826f74a6 req-72a548d7-7c42-4725-af81-ef428d4bff81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.171754 Sep 07 13:13:55.329335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 434/875] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:55.349132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:55.352060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:55.360300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:55.400551 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.405425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.420792 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.421634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.422190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.436861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.478608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-458c1f37-5674-49fc-a369-d952fadea07b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 200 len: 1331 microversion: 2.1 time: 0.669259 Sep 07 13:13:55.480411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 442/876] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:54 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 1331 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:56.030749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:56.049078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:56.055075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:56.055762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad2fd350-c3c6-4ac6-9d83-c62cd46227b9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1725 microversion: 2.20 time: 0.724125 Sep 07 13:13:56.058400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 435/877] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:55 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1725 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:13:56.556483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:56.561127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:56.588799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:56.590266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:56.591409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:56.593081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:56.594538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:56.595736 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:56.632026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 HTTP/1.1 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:13:56.648552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:13:56.655605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '557046c4-53f5-4652-abb6-20ae0c1143f0'} Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:56.662789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:13:56.675304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:13:56.686334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:56.688935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1682c5f6-8577-4922-9134-815cab7cd071 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 404 len: 111 microversion: 2.1 time: 0.114250 Sep 07 13:13:56.689566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 443/878] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:56 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:13:56.707346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad03d524-307a-44be-8704-6543f6980227 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '.version_select at 0x7fdc41d780d0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:56.797318 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad03d524-307a-44be-8704-6543f6980227 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-378439831" status: 202 len: 0 microversion: 2.1 time: 0.099894 Sep 07 13:13:56.800185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 436/879] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Sep 7 13:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-378439831 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:13:57.120837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:57.126393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:57.159043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.164295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:57.175401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:57.177403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.178564 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:57.180107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:57.553992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:57.586719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:57.590071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:57.592878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0391b53a-207e-4a0c-b30f-ba6d10c64be5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1657 microversion: 2.20 time: 0.480231 Sep 07 13:13:57.598760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 444/880] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:57 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1657 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:13:57.849657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd384fa3-24c0-47a6-8dc5-f6ad179994ef", "name": "network-vif-deleted", "tag": "e0c37a28-8c4d-47b5-9251-5dfb01dad9ec"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:57.908457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.916156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:57.917315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:57.950562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] Creating event network-vif-deleted:e0c37a28-8c4d-47b5-9251-5dfb01dad9ec for instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef on hv-cinder-85331 Sep 07 13:13:57.961754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-502d6335-696a-4fdb-9f97-0b23d3529ffa req-83321873-d3d0-4b87-a529-c4b732219a22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418511 Sep 07 13:13:57.963203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 437/881] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:58.679829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:58.682600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:58.703522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:58.704780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:58.712252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:58.714331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:58.715470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:58.716555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:58.793502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:58.794879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:58.796128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:58.800003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lazy-loading 'fault' on Instance uuid cd384fa3-24c0-47a6-8dc5-f6ad179994ef {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:58.811128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:58.884493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:58.906334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:58.910476 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:58.913381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cd1003f5-9ee3-4b2e-96cf-e55040a5e1c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 200 len: 1372 microversion: 2.20 time: 0.249783 Sep 07 13:13:58.914805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 445/882] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:58 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:13:59.123995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:59.126977 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:59.139402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.140893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.142300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.143857 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.145050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.145849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.314852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'services' on Instance uuid 220b5e26-01bc-4cee-83b3-abe0a93330b4 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:59.491695 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-772e298b-a7dd-46c0-8d85-3cf9880ee8ba tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments/a73383f1-fb3e-4de9-8393-ec23adf1f617" status: 202 len: 0 microversion: 2.1 time: 0.383516 Sep 07 13:13:59.492933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 438/883] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:13:59 2022] DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments/a73383f1-fb3e-4de9-8393-ec23adf1f617 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:13:59.508636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:59.512711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:59.528349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.529240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.530054 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.534684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.534684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.534684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.601452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-07266275-7a75-4df2-bcb6-382efc9e5d64 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100251 Sep 07 13:13:59.602695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 446/884] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:13:59 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:59.959533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:59.960823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:59.973503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.974512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.975307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.976572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.977396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.978154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.006323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef HTTP/1.1 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:14:00.010330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:14:00.013076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'cd384fa3-24c0-47a6-8dc5-f6ad179994ef'} Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:14:00.014806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:14:00.017931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:00.020460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:14:00.020460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dfa8792a-4a7a-4dce-afd7-d6ccbdb693a5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 404 len: 111 microversion: 2.20 time: 0.061867 Sep 07 13:14:00.020460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 439/885] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:13:59 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:14:00.026617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ccf3f37e-12f4-4310-b1bc-1cb237f58101 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '.version_select at 0x7fdc420f0dc0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:00.075288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ccf3f37e-12f4-4310-b1bc-1cb237f58101 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061771832" status: 204 len: 0 microversion: 2.20 time: 0.052816 Sep 07 13:14:00.076355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 447/886] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Sep 7 13:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061771832 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:14:00.624580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:00.629000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:00.642569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.643887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.644950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.646620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.647718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.648681 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.724704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3c1976e5-8771-4f89-934b-d3984c6869bc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107974 Sep 07 13:14:00.726077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 440/887] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:14:00 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:01.423782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d92639cd-33cc-402b-8d15-f91d4a746fa7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: .version_select at 0x7fdc41d55430>, body: {"keypair": {"name": "tempest-keypair-289900407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGO3L33Q5KaHsKpThGEG7FyLEzre+mfCCXnx2NYvbC7EjMfgpBYAruIjWZrPy9LNjmzxapToKdBMk82nrkggELLxl4dxrMZjnQrfu6YtGsbrlRKi965cKFO1GMKr8YXXw=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:01.474065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-d92639cd-33cc-402b-8d15-f91d4a746fa7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:01.482431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-d92639cd-33cc-402b-8d15-f91d4a746fa7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for user 5235207aa3b5477eb76215ebb4a43c98 and project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:01.533181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d92639cd-33cc-402b-8d15-f91d4a746fa7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118352 Sep 07 13:14:01.534222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 448/888] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Sep 7 13:14:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:14:01.749283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:01.753307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:01.766517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.767449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.768907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.769652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.770603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.771458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.843040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c9cab6cb-5bd2-4067-91a1-9133d65db3fd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103966 Sep 07 13:14:01.846932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 441/889] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:14:01 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:14:01.977890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:01.978338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:01.988559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.989328 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.990135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.991264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.991976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.992642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:02.049106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:14:02.205752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1775f7d1-c067-4fda-a90f-9534e67763b8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 204 len: 0 microversion: 2.1 time: 0.234773 Sep 07 13:14:02.211987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 449/890] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:14:01 2022] DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:14:02.223026 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:02.224147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:02.242137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:02.245570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:02.246618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:02.247981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:02.248643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:02.250121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:02.543652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:02.572308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-60745a43-9b30-4df1-a0ee-1b8a969297d5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1683 microversion: 2.1 time: 0.357042 Sep 07 13:14:02.573169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 442/891] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:02 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1683 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:03.628837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:03.631510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:03.652620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:03.653936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:03.655148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:03.658238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:03.659475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:03.660245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:04.059281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:04.076330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3d3ea701-208a-4e14-9779-47d1611ac272 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1683 microversion: 2.1 time: 0.454538 Sep 07 13:14:04.078069 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 450/892] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:03 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1683 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:04.626594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-670529072", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96da8e0f-45fb-42a6-934a-e34883330b52"}], "security_groups": [{"name": "tempest-securitygroup--605587600"}], "key_name": "tempest-keypair-289900407", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:04.945496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] validate_networks() for [('96da8e0f-45fb-42a6-934a-e34883330b52', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:14:05.064750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220b5e26-01bc-4cee-83b3-abe0a93330b4", "name": "network-vif-deleted", "tag": "63ed0758-4564-4a5f-b057-7bdbda974012"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:05.109631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:05.111062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:05.112030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:05.146635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] Creating event network-vif-deleted:63ed0758-4564-4a5f-b057-7bdbda974012 for instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 on hv-cinder-85331 Sep 07 13:14:05.159828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-99256a50-f329-4c69-83a7-a7231ae8d52e req-18605ecd-3d9e-4165-bff8-f5ff92a45513 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117007 Sep 07 13:14:05.161835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 451/893] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:05.174420 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:05.177255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:05.192004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:05.193415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:05.194665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:05.196739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:05.198428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:05.199677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:05.422675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:05.452988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-63c2967e-9036-4e43-8e47-0ed87605a147 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 200 len: 1327 microversion: 2.1 time: 0.288591 Sep 07 13:14:05.454763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 452/894] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:05 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 1327 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:05.868878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:14:05.870408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:14:05.871147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:14:05.871881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:14:05.872623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:14:05.891422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:05.892307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:05.893081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:05.895138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:05.895925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:05.897107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:05.936303 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:05.945762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Getting quotas for user 5235207aa3b5477eb76215ebb4a43c98 and project f1959b8e00bc4819a993fdbd0c012f5c. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:05.972972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:14:05.977379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:14:06.078236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-be9cd84f-1ccf-4819-8268-5570ec1e86c2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.461761 Sep 07 13:14:06.079622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 443/895] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Sep 7 13:14:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:14:06.109862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:06.112523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:06.247913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:06.267129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:06.272071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:06.274912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-738eea07-261f-4c6a-8388-f06a9123fc8a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1280 microversion: 2.20 time: 0.174942 Sep 07 13:14:06.277946 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 453/896] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:06 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:06.493847 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:06.495178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:06.508033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:06.509343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:06.510535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:06.512137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:06.513220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:06.514356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:06.546641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 HTTP/1.1 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:14:06.556353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:14:06.559348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '220b5e26-01bc-4cee-83b3-abe0a93330b4'} Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:14:06.560902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:14:06.563345 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:14:06.572865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:14:06.572865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c9c8913c-2b1f-453a-a446-7acf3acdcac7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 404 len: 111 microversion: 2.1 time: 0.078900 Sep 07 13:14:06.572865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 444/897] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:06 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:14:06.581359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-72dcabe6-0c74-4419-b1c8-56067c6489a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '.version_select at 0x7fdc41d68940>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:06.622871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-72dcabe6-0c74-4419-b1c8-56067c6489a1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941015723" status: 202 len: 0 microversion: 2.1 time: 0.048733 Sep 07 13:14:06.623934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 454/898] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 13:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941015723 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:14:07.325995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:07.328631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:07.356939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:07.358497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:07.360048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:07.361625 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:07.362616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:07.364659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:07.508689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:07.551972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:07.554890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:07.557188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9bad59cf-9e58-4824-99c9-358a173be7f0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1276 microversion: 2.20 time: 0.240036 Sep 07 13:14:07.559009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 445/899] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:07 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:08.004805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9bd2b4a1-444e-415c-9cb6-256720d08aee tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: .version_select at 0x7fdc41dab280>, body: {"keypair": {"name": "tempest-keypair-2061774095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMClfE72WrWbSQ6SnuCKuEdfS5aWZYyXdPI3+g/SWW1/JW97VS+IGJpxqwupGKw6w9ncLN91fNZ5T/p8CNhw/ewF37B5z6xaN7luCKSaWwkjGhdvjcJ/Vo1bmUKltWgErw=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:08.032540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-9bd2b4a1-444e-415c-9cb6-256720d08aee tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:08.042180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-9bd2b4a1-444e-415c-9cb6-256720d08aee tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:08.083030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9bd2b4a1-444e-415c-9cb6-256720d08aee tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083422 Sep 07 13:14:08.084168 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 455/900] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:14:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:08.612203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:08.613283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:08.625295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:08.626579 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:08.627759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:08.629329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:08.630424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:08.631479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:09.160460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:09.176269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:09.181252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:09.181252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bf05a250-49ce-4e9e-9bba-98a5a7a91b14 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1340 microversion: 2.20 time: 0.576290 Sep 07 13:14:09.182379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 446/901] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:08 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1340 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:10.218105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:10.219881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:10.235897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:10.237217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:10.238059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:10.239364 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:10.240275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:10.241015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:10.351481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1919490607", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b6a96b-b474-4212-8454-464c32633cf7"}], "security_groups": [{"name": "tempest-securitygroup--149480921"}], "key_name": "tempest-keypair-2061774095", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:10.607832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:10.634528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:10.637504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:10.639739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3bffaf68-22a4-45a7-8569-31b9493490a2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.427300 Sep 07 13:14:10.641616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 456/902] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:10 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:10.703067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] validate_networks() for [('58b6a96b-b474-4212-8454-464c32633cf7', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:14:11.690874 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:11.692781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:11.705876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:11.706892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:11.708549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:11.709939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:11.710815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:11.711580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:11.744501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:14:11.746489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:14:11.747135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:14:11.749006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:14:11.749656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:14:11.764101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:11.765412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:11.767900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:11.769126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:11.769930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:11.770621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:11.803454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:11.808668 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:11.836521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:14:11.840794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:14:11.961495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-03654592-ddf6-4ef1-95d8-56159baa2156 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.620611 Sep 07 13:14:11.962690 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 447/903] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:14:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:14:11.991021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-44dfe9d6-4551-495b-8598-130a15ba0e2d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:11.992784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-44dfe9d6-4551-495b-8598-130a15ba0e2d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:12.007845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:12.040302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:12.040302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:12.042817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8c34d64f-a551-4a67-9a12-82a7a7a8389f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.361698 Sep 07 13:14:12.044792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 457/904] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:11 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:12.169254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-44dfe9d6-4551-495b-8598-130a15ba0e2d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:12.184493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-44dfe9d6-4551-495b-8598-130a15ba0e2d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1242 microversion: 2.1 time: 0.205980 Sep 07 13:14:12.185581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 448/905] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:11 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:12.249789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:12.273970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:12.275254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:12.275600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:12.304087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] Creating event network-changed:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:14:12.314126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-6c1591b7-ea59-4bc3-9fa8-5b6f2827ae34 req-39016f12-bf14-47bf-8323-ea18ba629e88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069738 Sep 07 13:14:12.315901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 458/906] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:13.091119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:13.092020 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:13.104280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:13.105127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:13.105967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:13.107210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:13.108039 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:13.108789 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:13.223650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:13.224430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:13.235513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:13.236289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:13.236933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:13.238006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:13.238574 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:13.239170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:13.311900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:13.328285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:13.331821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:13.334110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d52336a5-861d-49fa-9bda-5ef641f4794d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.250566 Sep 07 13:14:13.335186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 449/907] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:13 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:13.358392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:13.373301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-040b783a-a8b7-490f-82b0-025018fdbcd8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1294 microversion: 2.1 time: 0.155144 Sep 07 13:14:13.374430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 459/908] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:13 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:14.376079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:14.376929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:14.380084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:14.388784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.389440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.389910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.390631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.391082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.391638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.413708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:14.414655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:14.426367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.427586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.427873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.429371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:14.430235 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:14.431029 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:14.533607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:14.549350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-db140126-2c02-4be5-972b-f4ab5e54ec5a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1294 microversion: 2.1 time: 0.140003 Sep 07 13:14:14.550611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 460/909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:14 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:14.638781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:14.654108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:14.656716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:14.658606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eaee649d-a6d9-4f9f-a9f0-eadf308785a3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.288233 Sep 07 13:14:14.659419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 450/910] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:14 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:15.578294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:15.579576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:15.592294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:15.593778 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:15.594868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:15.596462 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:15.597280 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:15.598037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:15.706247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:15.708701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:15.722594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:15.723497 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:15.724277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:15.725429 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:15.726451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:15.727155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:15.729749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:15.762810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dce6570e-c394-4f2d-baaa-ca43705c27c4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1294 microversion: 2.1 time: 0.189411 Sep 07 13:14:15.766832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 461/911] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:15 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1294 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:16.116204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:16.126980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:16.128923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:16.130317 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-691f2c73-0d43-4ea0-ba24-f83a2aeacead tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.438706 Sep 07 13:14:16.130894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 451/912] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:15 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:16.811591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:16.812757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:16.825717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:16.826448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:16.827269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:16.828601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:16.829514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:16.830336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:17.160688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:17.161605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:17.172665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:17.173535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:17.174592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:17.175890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:17.176733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:17.177505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:17.187203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:17.203952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-71ef6154-8858-4b05-a31f-43e919caffae tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1300 microversion: 2.1 time: 0.399413 Sep 07 13:14:17.205979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 462/913] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:16 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1300 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:17.420276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:17.433291 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:17.436092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:17.438255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e5f12c47-330a-40bf-8453-523d04f655d4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.284956 Sep 07 13:14:17.439189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 452/914] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:17 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:18.249428 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:18.250730 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:18.255060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=10 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:18.265763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:18.266896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:18.267700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:18.269101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:18.269973 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:18.270731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:18.481825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:18.482995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:18.497137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:18.498408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:18.499181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:18.500910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:18.502161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:18.503188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:18.693253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:18.722185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3932e931-5bea-418e-9bb3-82fd5acfaea7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.479828 Sep 07 13:14:18.724136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 463/915] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:18 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:18.778093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:18.791635 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:18.793961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:18.795908 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-63bd1ca3-b897-40da-8564-2b9c9d6ed7b4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.320389 Sep 07 13:14:18.798728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 453/916] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:18 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:19.318170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccb0d34-170a-4797-8443-06083751ad8c", "tag": "14bb5043-a130-4481-ab83-c2c1d6c60fe2"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:19.337338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:19.338644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:19.339392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:19.361925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] Creating event network-changed:14bb5043-a130-4481-ab83-c2c1d6c60fe2 for instance fccb0d34-170a-4797-8443-06083751ad8c on hv-cinder-85331 Sep 07 13:14:19.381691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-10db4d7b-dd93-4de8-bf19-b512d256ac61 req-21e09179-6ebb-4a01-b443-fba90a86a1f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068725 Sep 07 13:14:19.387251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 464/917] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:19.772944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:19.774909 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:19.786101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:19.786787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:19.788397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:19.791326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:19.793086 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:19.793957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:19.845644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:19.848748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:19.867766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:19.870267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:19.871406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:19.873798 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:19.875341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:19.877329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:20.289078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:20.304156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1e7c8367-c4cb-46c6-b1be-be07b83e4483 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.539662 Sep 07 13:14:20.304943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 454/918] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:19 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:20.329270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "name": "network-vif-plugged", "status": "completed", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:20.344216 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:20.346027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:20.346443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:20.352538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:20.368624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] Creating event network-vif-plugged:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:14:20.385730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-97f36cf9-d5d1-4705-8273-f4c32c9192b8 req-25f61124-e419-4e4b-8566-fdfe10a645f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059716 Sep 07 13:14:20.385730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 455/919] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:20.523340 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:20.536659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:20.540946 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:20.542492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9cb7370e-b87a-4b52-af1a-3369284e41a8 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.718096 Sep 07 13:14:20.543377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 465/920] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:19 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:21.341148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:21.342588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:21.355334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:21.356191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:21.356975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:21.358338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:21.359174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:21.359915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:21.575393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:21.576264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:21.585612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:21.586343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:21.586797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:21.587531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:21.587987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:21.588416 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:21.606035 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:21.622627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2b5f7020-317a-4e81-aecb-f389c586f5c2 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.289938 Sep 07 13:14:21.623707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 456/921] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:21 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:21.831382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:21.848068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:21.851182 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:21.853303 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-49c8b289-5324-4a2a-8511-812bcb2d1ad2 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.282886 Sep 07 13:14:21.854390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 466/922] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:21 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:22.667617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:22.668723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:22.672261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:22.673749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=14 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:22.684994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:22.685784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:22.687309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:22.687309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:22.687975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:22.688650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:22.899312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:22.900429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:22.910445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:22.911281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:22.912296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:22.913502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:22.914259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:22.915033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:22.943380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:22.957156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:22.977588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e8cca16b-c38b-41f6-b438-b42eaa9654dd tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.317200 Sep 07 13:14:22.998043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 457/923] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:22 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:23.182592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:23.211353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:23.214972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:23.218355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-877075f6-823c-489b-9d53-271b9ab1c93f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.326288 Sep 07 13:14:23.220073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 467/924] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:22 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:24.014346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:24.015205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:24.032388 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:24.033285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:24.034132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:24.035673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:24.036389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:24.037191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:24.274091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:24.274091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:24.285626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:24.287225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:24.287932 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:24.288962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:24.289661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:24.290611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:24.355715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:24.371489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b3a96f74-18e2-49e8-a07d-f2d105a64c57 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.363437 Sep 07 13:14:24.372333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 458/925] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:24 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:24.577333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:24.590486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:24.593603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:24.595971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-df47e1ea-30b9-479e-a490-7dcedfdc5d33 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.329607 Sep 07 13:14:24.597580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 468/926] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:24 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:25.418276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:25.419400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:25.431508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.432351 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.433127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.434498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.435395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.436065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.644268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:25.645441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:25.650062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:25.660960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.661894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.663034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.664597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.665803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.666643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.713521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:25.730302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-114bc554-52f4-47a0-9b31-5156ae8d61de tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.318866 Sep 07 13:14:25.731333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 459/927] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:25 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:25.919916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:25.939045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:25.941060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:25.942483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-93a093a0-cf08-4f40-9dbc-d47765b83d78 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1405 microversion: 2.20 time: 0.305807 Sep 07 13:14:25.943228 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 469/928] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:25 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:14:26.267175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb0d34-170a-4797-8443-06083751ad8c", "name": "network-vif-plugged", "status": "completed", "tag": "14bb5043-a130-4481-ab83-c2c1d6c60fe2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:26.281049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:26.281496 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:26.281965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:26.304013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] Creating event network-vif-plugged:14bb5043-a130-4481-ab83-c2c1d6c60fe2 for instance fccb0d34-170a-4797-8443-06083751ad8c on hv-cinder-85331 Sep 07 13:14:26.312396 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-f8b4a5c7-42a7-43eb-a086-7d547ab4efbc req-18d493fb-98e3-4c9b-a819-086bc2e7ca03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052908 Sep 07 13:14:26.313655 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 460/929] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:26.777914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:26.779250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:26.798030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:26.799810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:26.800609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:26.801914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:26.802694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:26.803412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:26.991669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:26.992558 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:27.002568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.003409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.004203 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.005458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.006765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.006947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.044839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:27.061041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d232d82f-f39d-4ed0-b114-b6fc37f55231 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.289832 Sep 07 13:14:27.062095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 470/930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:26 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:27.244196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:27.261074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:27.263984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:27.265893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05d86112-a440-4399-8d13-150878f40fe5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1597 microversion: 2.20 time: 0.285739 Sep 07 13:14:27.266688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 461/931] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:14:26 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1597 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:14:27.295830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:27.296475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:27.303619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.304264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.304715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.305450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.305947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.306375 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.443498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-da087acf-fde9-4873-8eb6-7677a5c3b056 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152903 Sep 07 13:14:27.444560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 471/932] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Sep 7 13:14:27 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:14:28.104851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:28.106084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:28.118959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.119742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.120455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.121650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.122426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.123115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.364437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:28.379072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c01d9573-61e2-44e8-a8e6-4b6d2516a198 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1367 microversion: 2.1 time: 0.282173 Sep 07 13:14:28.380407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 462/933] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:28 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:29.426115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:29.427244 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:29.440498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.441965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.442939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.444488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.445600 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.446348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.509152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:29.538521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.539796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.542436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.576128 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] Creating event network-changed:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:14:29.585929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-4018d52a-7c19-4849-a5a3-54aac508527e req-faf11a2f-8d6e-4f66-ac7f-20fa3add952d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083830 Sep 07 13:14:29.587286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 463/934] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:29.839620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:29.870411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9c08c584-683e-4879-94e2-d1bea69d2485 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1558 microversion: 2.1 time: 0.456507 Sep 07 13:14:29.892226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 472/935] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:29 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1558 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:29.933794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:29.936967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:29.974546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.974546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.978914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.980111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.981013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.981945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:30.204582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3a50fae5-3a4e-4857-81c2-59e2cd7998f1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.281145 Sep 07 13:14:30.205920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 464/936] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:14:29 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-interface => generated 285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:32.095952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccb0d34-170a-4797-8443-06083751ad8c", "tag": "14bb5043-a130-4481-ab83-c2c1d6c60fe2"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:32.107786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:32.108281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:32.108718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:32.124143 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] Creating event network-changed:14bb5043-a130-4481-ab83-c2c1d6c60fe2 for instance fccb0d34-170a-4797-8443-06083751ad8c on hv-cinder-85331 Sep 07 13:14:32.131879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-b019fe0e-ff24-470a-a0f5-81b53ca538b7 req-8ebbbcbc-ef19-46ae-a9f1-eab3f0cffb02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039073 Sep 07 13:14:32.132944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 473/937] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:34.743188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:34.744397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:34.750790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.751266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.752665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.753245 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.753735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.754171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.843500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lazy-loading 'services' on Instance uuid 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:14:34.937083 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-493250c2-58b9-437f-b589-fe34390b4290 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments/0d42db35-c89f-4436-a163-e7d6b0650df1" status: 202 len: 0 microversion: 2.1 time: 0.364311 Sep 07 13:14:34.938019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 465/938] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:14:34 2022] DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments/0d42db35-c89f-4436-a163-e7d6b0650df1 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:14:37.194767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:37.209037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:37.209958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:37.210777 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:37.287511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Going to try to stop instance {{(pid=120817) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:14:37.356652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-51fd0fb8-6637-44b0-9e8a-17dba24277f8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action" status: 202 len: 0 microversion: 2.1 time: 0.167056 Sep 07 13:14:37.357281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 474/939] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:14:37 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:14:37.374103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:37.374716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:37.384016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:37.384621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:37.385100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:37.385901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:37.386406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:37.386838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:37.620223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:37.633061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-18e6208e-997f-4456-8818-456867be1346 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.264351 Sep 07 13:14:37.633719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 466/940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:37 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:38.663170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:38.664203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:38.673607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:38.674166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:38.674635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:38.675353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:38.676275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:38.676275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:38.872173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:38.887127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f41fccf2-2d11-4dc1-aaf4-49da78117567 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.230972 Sep 07 13:14:38.888205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 475/941] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:38 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:39.924595 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:39.925235 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:39.932629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:39.933204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:39.933548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:39.934291 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:39.934738 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:39.935155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:40.131101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:40.145614 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-78ecb54c-85d5-4c98-b695-6c5c05171c0d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.226190 Sep 07 13:14:40.146257 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 467/942] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:39 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:41.172758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:41.173508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:41.183638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:41.184359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:41.185059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:41.186050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:41.186695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:41.187288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:41.365190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:41.380957 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5ab31f8a-378f-4542-822c-a4038976b822 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.213515 Sep 07 13:14:41.395128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 476/943] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:41 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:42.413612 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:42.414471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:42.422286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:42.422780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:42.423227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:42.424109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:42.424890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:42.424890 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:42.593107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:42.605019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-49d14acb-bd4f-4abe-8377-4db68d38b1e6 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.196302 Sep 07 13:14:42.605621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 468/944] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:42 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:43.634153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:43.635035 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:43.646625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:43.647134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:43.647569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:43.648276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:43.648733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:43.649259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:43.829023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:43.838388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e759185c-baaa-4159-9959-be85f73f0062 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.208318 Sep 07 13:14:43.838976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 477/945] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:43 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:44.865482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:44.866147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:44.868870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=38 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:44.876653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:44.877413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:44.878115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:44.879308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:44.880068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:44.880642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:45.059786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:45.073739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82dc50f3-9b53-4be3-984d-b22849b62d90 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.211949 Sep 07 13:14:45.074759 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 469/946] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:44 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:46.110540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:46.111155 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:46.118474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.118961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.119407 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.120222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.120747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.121260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.287858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:46.303172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b1f3b7c9-ed2a-44e0-b136-f8a6e8bf2697 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.196212 Sep 07 13:14:46.304195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 478/947] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:46 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:47.330488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:47.331258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:47.339766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.340263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.340701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.341888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.342370 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.342805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.534155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:47.544314 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4c42f4cf-c9de-44d8-94eb-daa8e463b1d5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1677 microversion: 2.1 time: 0.219124 Sep 07 13:14:47.545040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 470/948] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:47 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:48.573006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:48.574109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:48.582822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.583398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.584044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.589363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.589363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.589363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.757584 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:48.768575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-be2dd833-a47b-499f-ab06-9508eaa41d9a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1654 microversion: 2.1 time: 0.200679 Sep 07 13:14:48.769254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 479/949] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:48 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1654 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:48.795645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:48.804557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.805348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.805885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.835348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Going to try to start instance {{(pid=120818) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:14:48.892439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5ba5c91a-a2b1-4da6-a271-52f0e37d7cd7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action" status: 202 len: 0 microversion: 2.1 time: 0.102620 Sep 07 13:14:48.893782 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 471/950] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:14:48 2022] POST /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:14:48.903269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:48.904393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:48.913429 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.913865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.914423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.915296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.915847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.916396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:49.121696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:49.131326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-89b851b6-88a5-4afd-b6e7-9c93c74cfc50 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1663 microversion: 2.1 time: 0.232710 Sep 07 13:14:49.131934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 480/951] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:48 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1663 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:50.171377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:50.172195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:50.180455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:50.181000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:50.181478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:50.182265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:50.182756 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:50.183293 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:50.207139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:50.386822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:50.398444 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-598a984d-d9d6-4e8b-86cb-12a9937635d9 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1663 microversion: 2.1 time: 0.233464 Sep 07 13:14:50.399699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 472/952] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:50 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1663 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:51.439278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:51.440195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:51.451799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:51.452688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:51.453406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:51.454696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:51.455555 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:51.456412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:51.652095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:51.661109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fd55d0fb-47a9-45f9-bf77-c2c131316ec4 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1667 microversion: 2.1 time: 0.228390 Sep 07 13:14:51.661980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 481/953] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:51 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1667 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:56.698503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:56.699336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:56.708845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:56.709440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:56.709947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:56.710673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:56.711126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:56.711575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:56.853191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'services' on Instance uuid 528dbaca-73da-4486-8574-ab5c8399150a {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:14:56.991682 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3d3dd9c2-88a5-4e7a-be83-e43b303368e5 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments/d465e147-4622-473c-821b-999b3c9bfc10" status: 202 len: 0 microversion: 2.1 time: 0.296365 Sep 07 13:14:56.992879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 473/954] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:14:56 2022] DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments/d465e147-4622-473c-821b-999b3c9bfc10 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:14:57.008178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:57.012107 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:57.015868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:14:57.016127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments (ip 10.222.0.17) !!! Sep 07 13:14:57.017835 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=26 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:57.029099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:57.030085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:57.030267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:57.031522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:57.032337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:57.033105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:57.039727 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:57.087883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c1b90294-b739-4879-a25f-e9e24532ce2d tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087906 Sep 07 13:14:57.088621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 482/955] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:14:56 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:58.109549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:58.114954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:58.126700 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.128001 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.128964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.129731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.130252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.130882 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.196850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d46cd212-a85b-4e1f-9b50-9ec869fc3c32 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096203 Sep 07 13:14:58.198076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 474/956] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:14:58 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:14:58.334977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:58.335945 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:58.348227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.348970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.349812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.351119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.352219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.353003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.404999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:14:58.570198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-11fa3dc1-f0a7-4daf-b731-224892094ead tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 204 len: 0 microversion: 2.1 time: 0.242075 Sep 07 13:14:58.571255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 483/957] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:14:58 2022] DELETE /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:14:58.591488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:58.592652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:58.603277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.604373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.604952 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.606093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.606946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.607684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.848686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:58.862621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ee50a511-7b09-43e5-a7f4-1b8042023e44 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1689 microversion: 2.1 time: 0.277767 Sep 07 13:14:58.863359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 475/958] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:58 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1689 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:59.901566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:59.902628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:59.914938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:59.915744 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:59.916517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:59.918090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:59.919157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:59.920009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:00.171068 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:00.182404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-756c7d18-049c-404f-acf1-d8ede98511fa tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1689 microversion: 2.1 time: 0.289447 Sep 07 13:15:00.182971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 484/959] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:59 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1689 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:01.220261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:01.221619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:01.236505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:01.237567 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:01.238410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:01.239702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:01.240519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:01.241289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:01.488684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:01.503650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7b850ced-3ae7-4a6c-9a07-5e378cf593e7 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1689 microversion: 2.1 time: 0.290647 Sep 07 13:15:01.504709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 476/960] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:01 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1689 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:02.550304 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:02.551748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:02.564781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:02.565718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:02.568687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:02.570261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:02.571125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:02.571925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:02.822481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:02.834013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6d320b76-a0df-4f80-8e9e-e00821b2c235 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1689 microversion: 2.1 time: 0.292687 Sep 07 13:15:02.834882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 485/961] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:02 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:03.414275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528dbaca-73da-4486-8574-ab5c8399150a", "name": "network-vif-deleted", "tag": "21f071cd-5e2d-4258-8058-d8ae347d9b09"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:03.435309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:03.436223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:03.437011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:03.459222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] Creating event network-vif-deleted:21f071cd-5e2d-4258-8058-d8ae347d9b09 for instance 528dbaca-73da-4486-8574-ab5c8399150a on hv-cinder-85331 Sep 07 13:15:03.484264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-9fee31dd-566d-45f5-9f66-a7fde48725c1 req-d2481fd5-26c1-4146-846b-262ebe6fc28e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068037 Sep 07 13:15:03.485794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 477/962] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:15:03.883163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:03.884339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:03.899033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:03.899033 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:03.900758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:03.900758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:03.902186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:03.902781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:03.973729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:03.974590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:03.975310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:03.976142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'fault' on Instance uuid 528dbaca-73da-4486-8574-ab5c8399150a {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:04.074752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:04.099399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-223d7d3f-0a32-4549-8125-c92fcb9c0964 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 200 len: 1336 microversion: 2.1 time: 0.224342 Sep 07 13:15:04.100621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 486/963] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:03 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:05.142820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:05.144244 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: 528dbaca-73da-4486-8574-ab5c8399150a] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:05.156063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:05.156962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:05.157802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:05.159515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:05.160087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:05.160833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:05.193154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] HTTP exception thrown: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Request method failure captured: Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a HTTP/1.1 Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdNYMn96FfG87ejrN3gZhTeySUroTnqKfMThkVCKaxgitJxut8GKAznk9hHfeRez9ivmWqQdH_2aioZNLNl5zDfcleKvIleAAgYNdM5_zqbmHl4DTW0pLKS6QEhjGzWSxuctpXSyaetu0e3jF1VX35lmS8mkZ3AvdYrthqnIH0gphY Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:15:05.196426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9bb55accaa9046d99253a42a3154fe1b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 3cad6d025da54eb29d09fd2a2888c844 Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. Sep 07 13:15:05.199380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '528dbaca-73da-4486-8574-ab5c8399150a'} Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:05.201024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. Sep 07 13:15:05.211591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:15:05.213481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Returning 404 to user: Instance 528dbaca-73da-4486-8574-ab5c8399150a could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:05.213481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c6d87467-97c1-4b3c-873f-ac190567824e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a" status: 404 len: 111 microversion: 2.1 time: 0.070266 Sep 07 13:15:05.213481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 478/964] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:05 2022] GET /compute/v2.1/servers/528dbaca-73da-4486-8574-ab5c8399150a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:05.213950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2aa78599-9809-46cd-96b9-3294a2e888a3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '.version_select at 0x7fdc41f49f70>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:05.249703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2aa78599-9809-46cd-96b9-3294a2e888a3 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094163060" status: 202 len: 0 microversion: 2.1 time: 0.043048 Sep 07 13:15:05.250729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 487/965] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 13:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094163060 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:15:08.781919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:08.782804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:08.796749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:08.797580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:08.801079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:08.802439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:08.803330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:08.804144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:08.857362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:15:09.017455 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-228692f8-7ac5-4dc9-8cdf-8a803be9fd2e tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 204 len: 0 microversion: 2.1 time: 0.242013 Sep 07 13:15:09.023817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 479/966] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:15:08 2022] DELETE /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:15:09.036605 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:09.037915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:09.050765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:09.051669 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:09.052483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:09.053899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:09.054793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:09.055606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:09.311893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:09.321336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f51c7113-da35-4ac0-ae5a-d5d60fc634dc tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1508 microversion: 2.1 time: 0.295512 Sep 07 13:15:09.322083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 488/967] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:09 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:10.368586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:10.370098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:10.382195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:10.383155 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:10.384021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:10.385896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:10.385896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:10.385896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:10.783441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:10.800062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ed4c20cb-be95-40f9-b949-f5bf0bdb820c tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1508 microversion: 2.1 time: 0.440204 Sep 07 13:15:10.801123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 480/968] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:10 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:11.000398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d592ba-7265-4b01-a55a-505ba33bbf71", "name": "network-vif-deleted", "tag": "d4733634-c8bc-4e15-a679-5d5589eb48af"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:11.026645 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:11.027507 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:11.028032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.046539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] Creating event network-vif-deleted:d4733634-c8bc-4e15-a679-5d5589eb48af for instance a7d592ba-7265-4b01-a55a-505ba33bbf71 on hv-cinder-85331 Sep 07 13:15:11.054634 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-3549ef53-0925-4938-b739-50bb5c52352b req-9bcf2e73-3346-4ed0-b464-a7b0c790d5cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069803 Sep 07 13:15:11.056046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 489/969] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:11.839790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:11.849730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:11.860075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:11.860975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:11.861815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.863234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:11.864035 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:11.864760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.925961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:11.926899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:11.927632 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.928445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'fault' on Instance uuid a7d592ba-7265-4b01-a55a-505ba33bbf71 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:11.999154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:12.012297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b741c23-40b4-4662-80f8-88e6cdfd5355 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 200 len: 1312 microversion: 2.1 time: 0.180499 Sep 07 13:15:12.013098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 481/970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:11 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:13.054333 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:13.055349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: a7d592ba-7265-4b01-a55a-505ba33bbf71] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.064706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.065448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.066967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.068034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.068666 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.069278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.092830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] HTTP exception thrown: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Request method failure captured: Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 HTTP/1.1 Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdNYMn96FfG87ejrN3gZhTeySUroTnqKfMThkVCKaxgitJxut8GKAznk9hHfeRez9ivmWqQdH_2aioZNLNl5zDfcleKvIleAAgYNdM5_zqbmHl4DTW0pLKS6QEhjGzWSxuctpXSyaetu0e3jF1VX35lmS8mkZ3AvdYrthqnIH0gphY Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:15:13.095424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9bb55accaa9046d99253a42a3154fe1b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 3cad6d025da54eb29d09fd2a2888c844 Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. Sep 07 13:15:13.098323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'a7d592ba-7265-4b01-a55a-505ba33bbf71'} Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:13.100012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. Sep 07 13:15:13.102414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.104768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Returning 404 to user: Instance a7d592ba-7265-4b01-a55a-505ba33bbf71 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:13.104768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b5620640-3576-4b8e-b4e0-7e2d9d5cfed8 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71" status: 404 len: 111 microversion: 2.1 time: 0.051024 Sep 07 13:15:13.104768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 490/971] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:13 2022] GET /compute/v2.1/servers/a7d592ba-7265-4b01-a55a-505ba33bbf71 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:13.113779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:13.114722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.127362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.128350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.129282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.130391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.131251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.132053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.190898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:15:13.340434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3435c3f9-a7c9-42c9-af8d-0081426aa2b0 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 204 len: 0 microversion: 2.1 time: 0.234957 Sep 07 13:15:13.341333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 482/972] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:15:13 2022] DELETE /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:15:13.355302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:13.356505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.367864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.368758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.369566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.370918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.371757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.372539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.560477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:13.574551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-80601558-8bc0-4b8b-9b48-21dc1bdeb774 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.226732 Sep 07 13:15:13.575357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 491/973] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:13 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:14.606600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:14.607727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:14.624473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:14.625386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:14.626223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:14.627582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:14.628703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:14.629791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:15.045637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:15.061030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-053307e1-6eb1-416f-99f9-d9f04391cf31 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1521 microversion: 2.1 time: 0.459806 Sep 07 13:15:15.062153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 483/974] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:14 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:15.525211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6ea81b-c4bc-4032-a3d9-db69e5369416", "name": "network-vif-deleted", "tag": "04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:15.556899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:15.558176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:15.558987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:15.585459 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] Creating event network-vif-deleted:04d8a87d-17ac-4f37-9ecc-6bc805e8f4b6 for instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 on hv-cinder-85331 Sep 07 13:15:15.595038 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-0960c816-6384-4ff3-bc00-1ea462fc0c3f req-2db20a50-f606-4ebb-8ae1-1a73a1c94be3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075854 Sep 07 13:15:15.596073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 492/975] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:16.105127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:16.106077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:16.108939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:16.120483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:16.121300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:16.122376 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:16.123643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:16.124450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:16.125205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:16.186361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:16.187081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:16.187767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:16.188328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lazy-loading 'fault' on Instance uuid ec6ea81b-c4bc-4032-a3d9-db69e5369416 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:16.268147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cad6d025da54eb29d09fd2a2888c844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb55accaa9046d99253a42a3154fe1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:16.289558 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-434a70c8-e60f-4864-93ae-463424ce5d35 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 200 len: 1312 microversion: 2.1 time: 0.189269 Sep 07 13:15:16.291594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 484/976] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:16 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:17.337141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:17.338556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] [instance: ec6ea81b-c4bc-4032-a3d9-db69e5369416] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:17.351135 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:17.352020 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:17.352807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:17.354274 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:17.355122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:17.355899 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:17.382933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] HTTP exception thrown: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Request method failure captured: Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 HTTP/1.1 Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdNYMn96FfG87ejrN3gZhTeySUroTnqKfMThkVCKaxgitJxut8GKAznk9hHfeRez9ivmWqQdH_2aioZNLNl5zDfcleKvIleAAgYNdM5_zqbmHl4DTW0pLKS6QEhjGzWSxuctpXSyaetu0e3jF1VX35lmS8mkZ3AvdYrthqnIH0gphY Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:15:17.391716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9bb55accaa9046d99253a42a3154fe1b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9bb55accaa9046d99253a42a3154fe1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 9bb55accaa9046d99253a42a3154fe1b Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952422044 Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 3cad6d025da54eb29d09fd2a2888c844 Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952422044-project Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. Sep 07 13:15:17.393528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'ec6ea81b-c4bc-4032-a3d9-db69e5369416'} Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:17.395411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. Sep 07 13:15:17.398027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:15:17.400455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] Returning 404 to user: Instance ec6ea81b-c4bc-4032-a3d9-db69e5369416 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:17.400455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-025d80df-d456-48d1-a400-ef507ddc80b2 tempest-ServerRescueNegativeTestJSON-952422044 tempest-ServerRescueNegativeTestJSON-952422044-project] 10.222.0.17 "GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416" status: 404 len: 111 microversion: 2.1 time: 0.066369 Sep 07 13:15:17.400455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 493/977] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:17 2022] GET /compute/v2.1/servers/ec6ea81b-c4bc-4032-a3d9-db69e5369416 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:16:02.618534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:02.619477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:02.621894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:02.622746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:02.630827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:02.631564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:02.632102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:02.633090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:02.633831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:02.634445 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:02.676492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a18ad5dc-438c-44b3-8fc5-c541b8518975 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/ips" status: 200 len: 150 microversion: 2.1 time: 0.055830 Sep 07 13:16:02.676492 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 485/978] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:16:02 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:04.256850 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaaa711a-badb-4115-81bf-90221304118c"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:04.260529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:04.263529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:04.264269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:04.274073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:04.274747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:04.275283 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:04.276081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:04.276961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:04.277482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:04.789349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6ba269da-8ba2-4abf-937a-31dea35b866e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537102 Sep 07 13:16:04.790474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 494/979] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:16:04 2022] POST /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:08.462248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:08.465031 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:08.472721 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.473355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.474010 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.475004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.475691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.476210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.515672 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a7811ef0-fab9-4256-a762-d0ab533b05fd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057924 Sep 07 13:16:08.516651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 486/980] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:16:08 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:16:08.604566 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:08.605381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:08.612654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.613435 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.614220 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.615409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.616166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.616888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.670267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:16:08.832995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-086ec969-e5f3-4dfe-9904-dfa5c6ee19c3 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 204 len: 0 microversion: 2.1 time: 0.232942 Sep 07 13:16:08.834133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 495/981] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:16:08 2022] DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:16:08.848449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:08.850182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:08.861354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.862531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.863207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.864366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.865202 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.865940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:09.112896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:09.126702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d799aa16-273a-4e9c-bcab-ae3115d5c443 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1673 microversion: 2.1 time: 0.285059 Sep 07 13:16:09.127752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 487/982] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:08 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:10.163185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:10.164310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:10.173504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:10.174478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:10.175157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:10.175986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:10.176445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:10.176862 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:10.376968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:10.391243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ea7388ae-2974-4d00-a0e8-f8c46bfdd37c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1673 microversion: 2.1 time: 0.232236 Sep 07 13:16:10.392271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 496/983] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:10 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:11.435694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:11.436826 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:11.450582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:11.451437 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:11.452205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:11.454239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:11.458757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:11.458757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:11.844684 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:11.856731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e20e4b50-c3a8-4954-9f13-4a3694d74539 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1673 microversion: 2.1 time: 0.429482 Sep 07 13:16:11.857653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 488/984] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:11 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1673 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:12.475511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08cc93d9-9e4f-4c6a-adda-4f3f34ac099b", "name": "network-vif-deleted", "tag": "555b5068-66f6-4c6e-b495-1103b4954fa4"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:12.502453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.504487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.505573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.541588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] Creating event network-vif-deleted:555b5068-66f6-4c6e-b495-1103b4954fa4 for instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b on hv-cinder-85331 Sep 07 13:16:12.554387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-8bab8723-d2e1-463d-ba2e-b70fd93e3574 req-231ddf75-1604-4ff8-96a0-4323b4e59c46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082845 Sep 07 13:16:12.562018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 497/985] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:12.666853 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:12.668897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:12.679687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.680806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.681845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.682950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.684310 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.685365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.733214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4496f615-9cf2-41fd-8821-20b5d2ea0767 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/ips" status: 200 len: 150 microversion: 2.20 time: 0.076024 Sep 07 13:16:12.742439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 489/986] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Sep 7 13:16:12 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:16:12.748657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaaa711a-badb-4115-81bf-90221304118c"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:12.754309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:12.767936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.768614 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.769468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.771198 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.771999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.772811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.909385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:12.910426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:12.940372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.942399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.942399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.942759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c Sep 07 13:16:12.943572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.944459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.945249 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: POST /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments HTTP/1.1 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 74 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:16:12.946266 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {"volumeAttachment": {"volumeId": "eaaa711a-badb-4115-81bf-90221304118c"}} Sep 07 13:16:12.948980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'server_id': 'fccb0d34-170a-4797-8443-06083751ad8c', 'body': {'volumeAttachment': {'volumeId': 'eaaa711a-badb-4115-81bf-90221304118c'}}} Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:12.952979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:12.959031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 400 to user: Invalid volume: volume eaaa711a-badb-4115-81bf-90221304118c is already attached to instances: fccb0d34-170a-4797-8443-06083751ad8c {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:12.965974 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-030c797b-db3e-4eb4-becd-57ff85aaaaa0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216947 Sep 07 13:16:12.973046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 498/987] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:16:12 2022] POST /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments => generated 174 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:16:13.056056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.057300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.058299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.059803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lazy-loading 'fault' on Instance uuid 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:16:13.098401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:13.099389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:13.118967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.121306 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.122533 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.124840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.126242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.134269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.167639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:13.208391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb9aca5d-6f20-4906-851f-22a482224ab1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 200 len: 1327 microversion: 2.1 time: 0.319485 Sep 07 13:16:13.211077 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 490/988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:12 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 1327 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:13.374406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'services' on Instance uuid fccb0d34-170a-4797-8443-06083751ad8c {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:16:13.611110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7defbcbe-4be3-45d0-b5be-22e20055818f tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments/eaaa711a-badb-4115-81bf-90221304118c" status: 202 len: 0 microversion: 2.1 time: 0.520867 Sep 07 13:16:13.615024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 499/989] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:16:13 2022] DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments/eaaa711a-badb-4115-81bf-90221304118c => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:16:13.626384 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:13.630264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:13.643939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.644881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.646059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.648067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.650137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.651054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.722197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f15cd9f2-1c16-4aeb-bf36-c8c529a56957 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100625 Sep 07 13:16:13.724957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 491/990] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:16:13 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:14.249990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:14.251210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:14.259043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.259652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.260164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.260951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.261590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.262290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.288013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b HTTP/1.1 Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:16:14.290466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:16:14.292928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '08cc93d9-9e4f-4c6a-adda-4f3f34ac099b'} Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:14.294377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:16:14.296276 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:16:14.299828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:14.299828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5eb9c8c6-a428-41fd-b2f7-9da7649ffcd2 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 404 len: 111 microversion: 2.1 time: 0.051367 Sep 07 13:16:14.299828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 500/991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:14 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:16:14.319053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bc2ba0c3-809b-4349-b5e8-2ce80379c8fb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '.version_select at 0x7fdc41e8b820>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:14.362252 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bc2ba0c3-809b-4349-b5e8-2ce80379c8fb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631320152" status: 202 len: 0 microversion: 2.1 time: 0.055210 Sep 07 13:16:14.363344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 492/992] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Sep 7 13:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631320152 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:16:14.742053 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:14.745369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:14.754075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.754803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.755677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.757301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.758357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.759377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.835216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-afe730b1-e0f4-403d-8868-7fcf1eda1fd5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099588 Sep 07 13:16:14.836100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 501/993] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:16:14 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:16:14.968350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:14.969516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:14.980732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.981231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.981755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.982434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.982901 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.983333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.018021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:16:15.110329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:15.111695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:15.123852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.124841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.125882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.127417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.128308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.129113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.161776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-712c7eab-b41f-49ac-b588-cf23051a0232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 204 len: 0 microversion: 2.1 time: 0.198426 Sep 07 13:16:15.162916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 493/994] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:16:14 2022] DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:16:15.176919 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:15.177781 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:15.179022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lazy-loading 'flavor' on Instance uuid cb8fb954-ec5b-4262-b0e0-b2b973da6a25 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:16:15.186861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.187753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.188294 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.189999 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.190985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.191814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.549395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-61ac3823-f486-4570-bb68-a06bbd885def tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/action" status: 202 len: 0 microversion: 2.20 time: 0.446735 Sep 07 13:16:15.550427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 502/995] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 13:16:15 2022] POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:16:15.561553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-eed31a48-5ee5-4eac-a4f5-fdd3f77d55ec tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: .version_select at 0x7fdc41f49a60>, body: {"keypair": {"name": "tempest-keypair-1939648298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZFrI67+3XXXbkKWpmTWAF/IjR8WIbl/4AbvKaXnh6uqOyLTVPw+kFS0MtsisAMOh+40Cf8n5mzlbAYLt56qiP0Q9CJczGtEYBfaRhFkOlAAMphiIf91JMb6vp05ttwyw=="}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:15.586742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-eed31a48-5ee5-4eac-a4f5-fdd3f77d55ec tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for project b33fcaf2f89d4438947508dee3737cee. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:15.594223 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-eed31a48-5ee5-4eac-a4f5-fdd3f77d55ec tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for user 30153f2f99424f29afaf718784c9f6b1 and project b33fcaf2f89d4438947508dee3737cee. Resources: {'key_pairs'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:15.636003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-eed31a48-5ee5-4eac-a4f5-fdd3f77d55ec tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083609 Sep 07 13:16:15.636584 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 503/996] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:16:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:15.641545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:15.642311 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:15.654881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.655744 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.656589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.657813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:15.658583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:15.659338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.781529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:15.791334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1f0899d9-8634-4ac3-96e6-c4ca78af7ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1682 microversion: 2.1 time: 0.622015 Sep 07 13:16:15.792185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 494/997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:15 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1682 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:16.076090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:16.090273 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:16.092994 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:16.095109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9627b0e5-6cb6-4dae-a3b4-b3c86261c3d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.457197 Sep 07 13:16:16.096124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 504/998] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:15 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:16.825883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:16.826765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:16.842847 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:16.843799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:16.844515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:16.845838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:16.846692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:16.847463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:17.138360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:17.139431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:17.152478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:17.152478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:17.156080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:17.156080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:17.157885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:17.157885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:17.409884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:17.427419 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:17.430886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:17.433653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c3a0071a-8e88-4604-8c6b-22971e11a867 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.307003 Sep 07 13:16:17.436167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 505/999] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:17 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:17.699353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:17.712998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c8424f91-3af5-4cf9-b9ff-40060ffd460b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1682 microversion: 2.1 time: 0.894840 Sep 07 13:16:17.714119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 495/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:16 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1682 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:18.483263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:18.484101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:18.492004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:18.492606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:18.493293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:18.494087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:18.494561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:18.495021 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:18.741847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:18.749277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:18.750488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:18.767922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:18.768811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:18.770458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:18.772284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:18.773499 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:18.774638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:18.776368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:18.779931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:18.782704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-469d58af-a602-44ae-aa21-4e32cec24c9d tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.303478 Sep 07 13:16:18.799011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 506/1001] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:18 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:18.958711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:18.977281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a7a8e41e-0007-42ff-bc71-39b5bad854dc tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1615 microversion: 2.1 time: 0.234016 Sep 07 13:16:18.989708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 496/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:18 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1615 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:19.122481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-354745803", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dd23664-b42a-4d80-9c90-aa63bd35ceac"}], "security_groups": [{"name": "tempest-securitygroup--1047584797"}], "key_name": "tempest-keypair-1939648298", "user_data": "}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:19.324256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] validate_networks() for [('4dd23664-b42a-4d80-9c90-aa63bd35ceac', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:19.409737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb0d34-170a-4797-8443-06083751ad8c", "name": "network-vif-deleted", "tag": "14bb5043-a130-4481-ab83-c2c1d6c60fe2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:19.437957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:19.438745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:19.440405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:19.481964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] Creating event network-vif-deleted:14bb5043-a130-4481-ab83-c2c1d6c60fe2 for instance fccb0d34-170a-4797-8443-06083751ad8c on hv-cinder-85331 Sep 07 13:16:19.497922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-30f86c2f-fd8e-4401-af44-d4424bdff9a4 req-9af81981-7ff1-4d6a-ab27-680d8ece417e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125438 Sep 07 13:16:19.500196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 497/1003] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:19.847549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:19.847549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:19.862495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:19.870322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:19.875422 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:19.878730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:19.886021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:19.887436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.156808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:20.187974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:20.191439 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:20.193210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-db150023-0991-4d46-990e-56b9089ca571 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.367062 Sep 07 13:16:20.194656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 498/1004] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:19 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:20.205083 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:20.207479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:20.220964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:20.222613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:20.223702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.226464 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:20.227866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:20.229831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.296413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:20.297796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:20.299225 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.300307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'fault' on Instance uuid fccb0d34-170a-4797-8443-06083751ad8c {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:16:20.331049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:20.334104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:20.336769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:20.337852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:20.339708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:20.362736 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:20.363611 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:20.364550 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.366051 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:20.366821 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:20.367466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:20.383589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:20.384754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:20.407153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cbf3c51f-de9e-4761-bfd6-7e99c9444232 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 200 len: 1332 microversion: 2.1 time: 0.209932 Sep 07 13:16:20.408784 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 499/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:20 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 1332 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:20.422169 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for project b33fcaf2f89d4438947508dee3737cee. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:20.439185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Getting quotas for user 30153f2f99424f29afaf718784c9f6b1 and project b33fcaf2f89d4438947508dee3737cee. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:20.463163 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:20.468554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:20.553441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8b14077d-0943-46cc-9191-e251606f8525 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.444483 Sep 07 13:16:20.554620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 507/1006] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:20.570910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-99659374-e125-4101-ad27-d33a417e1117 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:20.571856 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-99659374-e125-4101-ad27-d33a417e1117 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:20.651416 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-99659374-e125-4101-ad27-d33a417e1117 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:20.670513 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-99659374-e125-4101-ad27-d33a417e1117 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1237 microversion: 2.1 time: 0.105573 Sep 07 13:16:20.680660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 500/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:20 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:21.246603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:21.248232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:21.262126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.262808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.263681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.264596 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.265142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.265964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.448441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:21.451921 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:21.478910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.481195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.482571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.484273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.485354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.487192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.512783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:21.526903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:21.529562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:21.531347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-46257982-5e6c-4c85-b807-99004c6753de tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.293545 Sep 07 13:16:21.532289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:16:21.533225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 508/1008] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:21 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c HTTP/1.1 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:16:21.536296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:16:21.539449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'fccb0d34-170a-4797-8443-06083751ad8c'} Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:16:21.541161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:16:21.544166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:16:21.551508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:16:21.564075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-75dbc072-896c-47a3-ac5e-8d143d98d8a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 404 len: 111 microversion: 2.1 time: 0.115284 Sep 07 13:16:21.577263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 501/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:21 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:16:21.587648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b1754945-1351-48c5-b785-d95178df97df tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '.version_select at 0x7fdc41f49ca0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:21.621128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b1754945-1351-48c5-b785-d95178df97df tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061774095" status: 202 len: 0 microversion: 2.1 time: 0.040449 Sep 07 13:16:21.622071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 509/1010] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 13:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061774095 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:16:21.699825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:21.700812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:21.711787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.713650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.714245 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.715783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:21.716823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:21.717820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:21.840352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:21.854644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-01af08ba-36c6-4218-b5b2-fe5167a7b42c tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1289 microversion: 2.1 time: 0.158321 Sep 07 13:16:21.855686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 502/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:21 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1289 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:22.576488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:22.577401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:22.585876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:22.587023 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:22.587794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:22.589001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:22.589844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:22.590594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:22.665823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad459bd9-8d20-4bd3-ab4c-3fec17cc846e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: .version_select at 0x7fdc41f4f790>, body: {"keypair": {"name": "tempest-keypair-1588758280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVOUPBNfYyQZvoQHIgdmzzXg9UkF3V+AYtRgzmErcN7nwX39XNzAQsiNr++H1OJ9zxMVYSRzf+7mCLoJRCBZ8zv5Go0+VkvbdrOCfuMfjSKqdMK5wbiH/YDYIwANtGVbA=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:22.696640 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-ad459bd9-8d20-4bd3-ab4c-3fec17cc846e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:22.703631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-ad459bd9-8d20-4bd3-ab4c-3fec17cc846e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:22.736166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad459bd9-8d20-4bd3-ab4c-3fec17cc846e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077145 Sep 07 13:16:22.737356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 503/1012] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:16:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:22.874785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:22.893460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:22.894004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:22.894691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:22.896215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:22.898578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ceae04b9-f74d-4d10-bcbb-dce66ab28e86 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.326398 Sep 07 13:16:22.907038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:22.907833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:22.908874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:22.910451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:22.911544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:22.912790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:22.914988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 510/1013] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:22 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:22.924236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:23.046173 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:23.062866 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8389dcca-bb43-4615-b502-1c6fa1715761 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1295 microversion: 2.1 time: 0.174644 Sep 07 13:16:23.064677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 504/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:22 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1295 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:23.942549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:23.944943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:23.967031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:23.968504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:23.970704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:23.972398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:23.973387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:23.975522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:24.109807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:24.111247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:24.120839 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:24.121413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:24.121805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:24.122534 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:24.122987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:24.123411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:24.304120 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:24.320245 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:24.322399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:24.324460 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8840f240-7a50-4c22-acb2-a0184db12265 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.389244 Sep 07 13:16:24.325921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 511/1015] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:23 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:24.459981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:24.473555 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f4e3eec5-a6d6-498e-b7a4-7f482be59309 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.372061 Sep 07 13:16:24.474626 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 505/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:24 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:24.951073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439d387-3f56-4965-bc16-3605c1377ced", "tag": "35fde959-4a97-4d9d-9a82-e0c3b3b61f75"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:24.968134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:24.971345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:24.972189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:24.996560 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] Creating event network-changed:35fde959-4a97-4d9d-9a82-e0c3b3b61f75 for instance 9439d387-3f56-4965-bc16-3605c1377ced on hv-cinder-85331 Sep 07 13:16:25.011580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-a30fe4f7-8c38-44c6-9d43-bfb69ccf4e49 req-8cc141b2-d46a-442b-bc19-12fa3aa30450 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065222 Sep 07 13:16:25.015786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 512/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:25.216350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-832673694", "imageRef": "91f02f06-ce66-4ea2-a640-8520d737e894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58b6a96b-b474-4212-8454-464c32633cf7"}], "security_groups": [{"name": "tempest-securitygroup--170107371"}], "key_name": "tempest-keypair-1588758280", "user_data": "}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:25.371131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:25.372250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:25.382118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:25.382797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:25.383486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:25.384373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:25.384839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:25.385297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:25.407472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.network.neutron [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] validate_networks() for [('58b6a96b-b474-4212-8454-464c32633cf7', None, None, None, None, None)] {{(pid=120818) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:25.595134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:25.611042 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:25.613204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:25.615329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-62e96e03-1d71-4a93-bcd4-e0fedb53be1c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.250105 Sep 07 13:16:25.616344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 513/1018] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:25 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:25.625510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:25.626652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:25.637865 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:25.639101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:25.640071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:25.641636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:25.642482 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:25.643225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:25.870101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:25.878624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4afa5e8d-53e8-446c-9cc0-e3ae6f1be9ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.261018 Sep 07 13:16:25.880492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 514/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:25 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:26.394645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:26.396214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image limits 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:26.398831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Flavor pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:26.399480 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Image pref 0:0:0 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:26.400105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.virt.hardware [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:26.420256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.424342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.424342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:26.424342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.424342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.425146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:26.446474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:26.451974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Getting quotas for user ca4779abc6024a0f84f041ca7c058e9a and project 317ea4e7108a4fc099da6d76a1793ac9. Resources: {'cores', 'ram', 'instances'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:26.472876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Going to run 1 instances... {{(pid=120818) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:26.476694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91f02f06-ce66-4ea2-a640-8520d737e894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:26.547399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [5c183ccb-ab6e-4a4f-bf36-4204eddce7b4] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:16:26.655175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:26.655954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:26.664226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.664889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.665370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:26.666261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.666717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.667142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:26.868290 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:26.878964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:26.881755 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:26.883324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c708276c-7724-4de4-9903-66ef379c9623 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.233837 Sep 07 13:16:26.883911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 515/1020] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:26 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:26.913831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:26.914337 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:26.928501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.929397 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.930126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:26.931462 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:26.932236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:26.933199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:27.138328 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:27.148553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2bde5f6b-c4ab-44dd-b0a5-4c5095702811 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.239747 Sep 07 13:16:27.149250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 516/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:26 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:27.558485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [5c183ccb-ab6e-4a4f-bf36-4204eddce7b4] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57698. Sep 07 13:16:27.567675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b9701adb-7cfa-4dca-af93-9f8970b047ec tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.358168 Sep 07 13:16:27.569256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 506/1022] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:27.585901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aab3babe-9155-4c59-9605-cba67c54e3c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:27.587101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aab3babe-9155-4c59-9605-cba67c54e3c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:27.683879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aab3babe-9155-4c59-9605-cba67c54e3c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:27.696035 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aab3babe-9155-4c59-9605-cba67c54e3c3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1241 microversion: 2.1 time: 0.114778 Sep 07 13:16:27.697077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 517/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:27 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:27.922527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:27.923457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:27.934005 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:27.934785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:27.935269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:27.936170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:27.936815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:27.937474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:28.175894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:28.177183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:28.188195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:28.189268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:28.190184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:28.191570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:28.192799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:28.193464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:28.442977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:28.456714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0489b426-cdbb-4751-9785-cbd4dcad0b30 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.287142 Sep 07 13:16:28.457761 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 518/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:28 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:28.486550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:28.496091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:28.497551 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:28.498862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1b2573e7-fbc6-44c6-b084-f7c1002f6473 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.582795 Sep 07 13:16:28.499431 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 507/1025] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:27 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:28.739058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:28.740232 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:28.755896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:28.756842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:28.757895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:28.759217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:28.760040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:28.760809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:28.868218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:28.880979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4fe3470d-959b-4caf-bc30-4bfecf780876 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1245 microversion: 2.1 time: 0.150261 Sep 07 13:16:28.881749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 519/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:28 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:29.489186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:29.490043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:29.497337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.497873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.498313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:29.499042 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.499600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.500021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:29.527498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:29.529965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:29.538511 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.539141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.540149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:29.541086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.541545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.542205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:29.703987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:29.720346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-66302425-991f-41e3-b48d-157fc56180c7 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.235357 Sep 07 13:16:29.721569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 508/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:29 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:29.756582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:29.770805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:29.773248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:29.774797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-19aec4ba-3cab-4361-a6d1-bc90b26d3137 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.252571 Sep 07 13:16:29.775406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 520/1028] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:29 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:29.920064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:29.921114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:29.933969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.934873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.935675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:29.936992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:29.937900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:29.938688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:30.042868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:30.060981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f9b8b43-c4fd-481b-99c2-e036b65d5ef4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1293 microversion: 2.1 time: 0.148499 Sep 07 13:16:30.063423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 509/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:29 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:30.765481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:30.767090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:30.778149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:30.783178 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:30.784341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:30.785030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:30.786509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:30.787442 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:30.789095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:30.816776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:30.822004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:30.837287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:30.838118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:30.838667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:30.839585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:30.840277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:30.841032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:31.149200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:31.160172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:31.182699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:31.187693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-572f5057-6a45-41e4-af78-a4c72a702bfe tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.430542 Sep 07 13:16:31.189474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 521/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:30 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:31.190450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:31.197967 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4bf8d29a-e462-4edd-9c7c-82b760dfdff4 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1741 microversion: 2.20 time: 0.387696 Sep 07 13:16:31.200176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:31.201597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:31.213911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 510/1031] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:30 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1741 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:31.219837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:31.221111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:31.221780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:31.223193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:31.223951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:31.224764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:31.337754 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:31.355805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa6f71ec-08e8-4364-a88e-d7b870da5ce4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1299 microversion: 2.1 time: 0.163492 Sep 07 13:16:31.357144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 522/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:31 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:32.224964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:32.226572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:32.241567 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.242960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.244081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.245514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.247935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.249009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.253545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:32.254896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:32.280488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.281539 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.282991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.287522 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.290366 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.291382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.545022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:32.564055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:32.567128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:32.569646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-79b13874-5042-4bcb-b79b-69e3fcccab90 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1741 microversion: 2.20 time: 0.334148 Sep 07 13:16:32.570739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 523/1033] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:32 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:32.577537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:32.578455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:32.587711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.588635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.589645 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.591712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.591928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.593009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.616291 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:32.633608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dcd0dced-3727-4673-a097-f44dd150eb0a tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.415604 Sep 07 13:16:32.634654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 511/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:32 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:32.737063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c56c8e8-883d-4fd0-9f85-6bf176d45b4f", "tag": "5bd262b4-dffa-4ecf-9712-914e429657ea"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:32.746613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:32.756879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:32.758174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:32.758940 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:32.797475 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] Creating event network-changed:5bd262b4-dffa-4ecf-9712-914e429657ea for instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f on hv-cinder-85331 Sep 07 13:16:32.807833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-0f55abd9-b740-4be7-a7a8-570c68e243d1 req-bd64f0cb-5ad1-4169-9a6c-1f928878ad35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077965 Sep 07 13:16:32.809704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 512/1035] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:32.823459 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:32.834325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-061e2eb5-e70b-4568-9137-dbc33080987d tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.261761 Sep 07 13:16:32.835698 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 524/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:32 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:33.606995 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:33.608017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:33.614207 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.614692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.615132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:33.615835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.616495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.616925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:33.664360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:33.665543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:33.669654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:33.675753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.676552 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.677229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:33.678960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.679118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.680148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:33.813280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:33.826982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:33.829313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:33.831197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1a5d8769-0a7d-443c-b959-f4bbf7a21b45 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1741 microversion: 2.20 time: 0.229726 Sep 07 13:16:33.832096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 513/1037] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:33 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:33.858592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:33.863674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:33.864982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:33.868738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9f2187b8-e8ec-4ee5-acdc-e92431d5ec08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.209467 Sep 07 13:16:33.869457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 525/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:33 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:33.877641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.878393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.879192 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:33.880560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:33.881549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:33.882552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.052059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:34.061764 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-480bb347-4e97-4338-bd37-2846baa9ec17 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.205722 Sep 07 13:16:34.062482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 514/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:33 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:34.752101 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439d387-3f56-4965-bc16-3605c1377ced", "name": "network-vif-plugged", "status": "completed", "tag": "35fde959-4a97-4d9d-9a82-e0c3b3b61f75"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:34.764065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.764677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.764961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.778828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] Creating event network-vif-plugged:35fde959-4a97-4d9d-9a82-e0c3b3b61f75 for instance 9439d387-3f56-4965-bc16-3605c1377ced on hv-cinder-85331 Sep 07 13:16:34.784990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-a722d68e-9f53-4c54-a51f-67b1fb4d3cf2 req-5b50b525-8b34-4c64-90d4-bcb84e8a4bc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043584 Sep 07 13:16:34.785625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 526/1040] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:34.872617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:34.873712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:34.886230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.886996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.887726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.889007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.889557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.890012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.898871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:34.900833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:34.909475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.910224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.910960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.911840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.912501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.913523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:35.084189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.098691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.100383 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.101928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9bf3d112-d74a-4d3c-a548-660ec1029c49 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1741 microversion: 2.20 time: 0.235765 Sep 07 13:16:35.119149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 515/1041] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:34 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:35.119149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:35.119149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:35.119149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:35.119739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:35.119739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:35.120821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:35.121369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:35.122163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:35.139191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.146670 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=100 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:35.158075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fc175ff1-6cd7-43a3-8b8b-86014be77bcc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.263546 Sep 07 13:16:35.158075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 527/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:34 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:35.317075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.325454 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-42b406e2-6e91-4245-ae1c-4c7b1905f722 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.221501 Sep 07 13:16:35.326283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 516/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:35 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:36.188277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:36.191762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:36.206587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.207768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.208883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.210762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.211852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.212891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.432334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:36.470506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=12 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:36.509498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:36.513699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:36.532501 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.534021 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.534964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.536112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.537195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.538381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.639166 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.651426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-af38eca9-c385-4cd8-8f0f-558137bf3844 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.468468 Sep 07 13:16:36.652466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 517/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:36 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:36.658835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:36.659633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:36.667099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.667704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.668495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.669815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.670466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.671063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.782789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.793130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.795093 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.796537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e2d7bb96-4806-4b38-822a-0e62243221c5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1741 microversion: 2.20 time: 0.646587 Sep 07 13:16:36.797307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 528/1045] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:36 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1741 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:36.811181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "name": "network-vif-plugged", "status": "completed", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:36.825801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:36.826653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:36.827409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:36.849377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] Creating event network-vif-plugged:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:16:36.858825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-46a86e95-21d1-427c-b5a1-4bd538d0c862 req-37f6bead-e644-4a5f-970b-aee01cb65198 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055663 Sep 07 13:16:36.859912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 529/1046] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:36.883951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.892960 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e7e00d9b-293e-4c6b-91b4-308f9e5c7bd7 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.239333 Sep 07 13:16:36.893560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 518/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:36 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:37.690898 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:37.691591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:37.695559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=12 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:37.702489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.703323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.703913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.704909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.705487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.706251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.834253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:37.835473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:37.845084 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.845708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.846330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.847198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.847963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.848712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.905255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:37.917030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fcf420a9-ff01-4c92-a0ba-2cad9077152e tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.231313 Sep 07 13:16:37.921080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 530/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:37 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:37.928433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:37.930681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:37.939869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.940415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.940826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.941568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.942079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.942508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:38.118873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:38.128711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2b635147-75fc-4e0f-8390-94ae35c9925e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.205904 Sep 07 13:16:38.142505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 531/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:37 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:38.151809 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:38.168427 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:38.170518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:38.172542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ff51f55f-d96e-4065-a643-60da0d8023dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.343847 Sep 07 13:16:38.173262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 519/1050] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:37 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:38.891487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c56c8e8-883d-4fd0-9f85-6bf176d45b4f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd262b4-dffa-4ecf-9712-914e429657ea"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:38.906149 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:38.906749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:38.907299 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:38.927963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] Creating event network-vif-plugged:5bd262b4-dffa-4ecf-9712-914e429657ea for instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f on hv-cinder-85331 Sep 07 13:16:38.938593 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-f3383890-a7e1-4b3b-9802-367edc1b3c21 req-8fa60a7f-cd8e-457e-bb54-5d0001ab660e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Sep 07 13:16:38.940688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 532/1051] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:38.950620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:38.952874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:38.968236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:38.969017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:38.969972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:38.971294 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:38.972201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:38.973041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.184487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:39.193270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:39.252411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.253576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.254318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.255990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.278344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.279524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.286386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.303196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7ba976da-cf85-4c73-af00-6ee0e9147a39 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1363 microversion: 2.1 time: 0.359232 Sep 07 13:16:39.304229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 520/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:38 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:39.314863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:39.316787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:39.330326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.332198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.333501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.335858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.337404 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.338307 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.645040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.656104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d91b6874-f58b-4452-a592-48436be5d944 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.493191 Sep 07 13:16:39.683222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 533/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:39 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:39.696320 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.714963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.716787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.718097 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-aa556eb6-3a1f-4269-ba9b-6d6f432697ef tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.411869 Sep 07 13:16:39.719052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 521/1054] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:39 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:40.347784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.349000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.358454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.359400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.360065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.361096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.361830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.362478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.564514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:40.575750 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-45b74994-c48d-4d40-8639-927bf8f68103 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1549 microversion: 2.1 time: 0.234479 Sep 07 13:16:40.589699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 534/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:40.611169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.611992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.626271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.627167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.627998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.629564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.630430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.631210 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.636272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=100 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:40.697183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.698115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.724200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.725596 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.726716 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.727830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.728861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.729916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.777631 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-33f6e6c4-189b-43cc-846b-4c5c1fbaeca5 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177221 Sep 07 13:16:40.789650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 522/1056] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:40.795887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.796726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.804978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.805976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.806622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.807732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.809029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.810091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.959339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:40.970918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-56feccf6-0ad4-44ba-b31a-6f3ae7d48ad3 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1366 microversion: 2.1 time: 0.281200 Sep 07 13:16:40.972295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 535/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:41.246053 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:41.264489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:41.267905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:41.270680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5e121aaf-8c95-48a2-a69e-793372851ed5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.479043 Sep 07 13:16:41.274061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 523/1058] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:42.007052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:42.008842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.019783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.020970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.022682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.023810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.024738 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.025517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.293720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:42.311565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:42.312573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.325645 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-27309198-bd36-4ad6-8454-07b95e04756b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1556 microversion: 2.1 time: 0.323509 Sep 07 13:16:42.327550 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 536/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:42 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:42.359568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.360489 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.361167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.362349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.363528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.364680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.372620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:42.373704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.392505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.395036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.396000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.397465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.399315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.401561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.570535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-985f87a2-33e6-4f5d-9b59-e2345605ab3c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207810 Sep 07 13:16:42.583557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 537/1060] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 13:16:42 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:43.116366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:43.138144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:43.145095 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:43.149459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-55219030-1a9d-4985-9ce5-450f158b4cf0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.845358 Sep 07 13:16:43.157291 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 524/1061] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:42 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:43.557477 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439d387-3f56-4965-bc16-3605c1377ced", "tag": "35fde959-4a97-4d9d-9a82-e0c3b3b61f75"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:43.612322 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.614140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.615293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.671978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] Creating event network-changed:35fde959-4a97-4d9d-9a82-e0c3b3b61f75 for instance 9439d387-3f56-4965-bc16-3605c1377ced on hv-cinder-85331 Sep 07 13:16:43.690334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-ec8cc725-e745-4960-961a-4f0ed132b85a req-e0a77bfc-8582-41a7-9881-aa68d84f63a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139283 Sep 07 13:16:43.692324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 538/1062] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:44.203669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:44.204654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:44.244527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:44.245653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:44.247714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:44.248817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:44.249494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:44.250884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:44.927140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.985191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.999486 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.009934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-29d547a7-215a-49ab-b652-f5e38b2bb6ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.808891 Sep 07 13:16:45.030313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 525/1063] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:44 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:45.218072 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c56c8e8-883d-4fd0-9f85-6bf176d45b4f", "tag": "5bd262b4-dffa-4ecf-9712-914e429657ea"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:45.273869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:45.275960 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:45.277699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:45.306363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] Creating event network-changed:5bd262b4-dffa-4ecf-9712-914e429657ea for instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f on hv-cinder-85331 Sep 07 13:16:45.316657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-70f2a27e-91e2-4e3a-a220-366a9072866e req-f52c1f82-fa31-42d7-9cbf-f226ca1dafb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124358 Sep 07 13:16:45.320254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 539/1064] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:46.068602 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:46.074652 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:46.107627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.110119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.111462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.113034 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.114006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.115011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.701380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.736761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.748285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.752260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f668c34a-5e51-45b1-a9f2-40dfb0f08ba6 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.690354 Sep 07 13:16:46.755313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 526/1065] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:46 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:47.792275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:47.793449 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:47.809443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.810358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.811620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.813390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.814291 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.815296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.115921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.129005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.131832 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.133653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9af90612-6606-496a-9bfc-b734a48195ae tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.351697 Sep 07 13:16:48.134363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 540/1066] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:47 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:49.178772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:49.180408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:49.198676 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.200006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.201322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.202937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.203734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.204460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.465370 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.491360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.495184 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:49.497588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f57c446-0185-44e0-b313-308216a8410e tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.324992 Sep 07 13:16:49.499361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 527/1067] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:49 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:50.546715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:50.548255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:50.562540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:50.563846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:50.564873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.566326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:50.568888 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:50.570841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.866561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:50.882807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:50.885817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:50.887504 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f74e2db7-ec9a-4100-97b3-f8ed500d6edd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.349784 Sep 07 13:16:50.888612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 541/1068] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:50 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:51.933519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:51.934849 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:51.946378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.947302 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.948164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.949981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.950929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.952018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:52.202368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:52.220653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:52.224240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:52.226511 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f706adb4-7784-422a-a165-bcecbd5bf208 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.300721 Sep 07 13:16:52.227488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 528/1069] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:51 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:53.262164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:53.263060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:53.272604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.273160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.273830 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.274601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.275127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.275577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.505844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.520587 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.522024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.523387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-308beb45-5c98-438c-a0aa-9d36e813fd05 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1736 microversion: 2.20 time: 0.267346 Sep 07 13:16:53.523801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 542/1070] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:53 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:16:54.557188 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.558329 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.570827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.572185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.572522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.573862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.574677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.575443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.942165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.955663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.957649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.959161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-23511022-3dfe-4080-8bc1-7b6d17f6500b tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1718 microversion: 2.20 time: 0.409963 Sep 07 13:16:54.959860 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 529/1071] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1718 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:55.993352 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:55.994279 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:56.002507 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.003362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.004008 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.004839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.005463 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.005971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.198031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.214283 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.217349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.219713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-74bfc592-e56b-408e-8c35-cf3123ebd5f5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1718 microversion: 2.20 time: 0.230237 Sep 07 13:16:56.220838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 543/1072] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:55 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:56.791666 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "name": "network-vif-unplugged", "status": "completed", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:56.811331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.812211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.812991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.834937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] Creating event network-vif-unplugged:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:16:56.844219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-32338b76-e896-419f-8caf-91fed66952c4 req-eb6996ce-f1a0-4a0b-a1cf-34d7865dfd2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057944 Sep 07 13:16:56.845102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 530/1073] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:57.257441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:57.258341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:57.265801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.266589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.267138 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.268045 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.268595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.269415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.465969 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.476108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.477551 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.478783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1409f599-6f09-4794-809e-f526a6339214 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1718 microversion: 2.20 time: 0.226957 Sep 07 13:16:57.479711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 544/1074] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:57 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:58.529367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:58.530261 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:58.540298 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.540993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.541529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.542421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.542998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.543487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.751907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:58.771431 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:58.774360 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:58.776418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5ba89e1e-e39c-4181-bb9c-a3003140017c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1661 microversion: 2.20 time: 0.254486 Sep 07 13:16:58.777159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 531/1075] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:16:58 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1661 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:16:58.811154 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc9c7499-7fe7-44cb-84e9-3efebb2f5b69"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:58.813934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:58.823253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.824735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.824735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.825904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.826164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.826782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.118404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:59.251041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3b0db207-6b84-4b71-9008-9e76cdcf20da tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.444528 Sep 07 13:16:59.251918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 545/1076] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Sep 7 13:16:58 2022] POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments => generated 188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:16:59.460195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:59.460654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:59.470375 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:59.471287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:59.472068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.473326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:59.474194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:59.474989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:59.905003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-85c31817-ed7c-43f3-8957-00ff96a76d2a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments/cc9c7499-7fe7-44cb-84e9-3efebb2f5b69" status: 202 len: 0 microversion: 2.20 time: 0.448808 Sep 07 13:16:59.906179 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 532/1077] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Sep 7 13:16:59 2022] DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments/cc9c7499-7fe7-44cb-84e9-3efebb2f5b69 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:17:00.003813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:00.004757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:00.012846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.013531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.014164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.015028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.015595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.016122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.096411 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120817) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:17:00.232114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aeda01ed-eea7-481c-9a21-d5aa6f5d38af tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/action" status: 202 len: 0 microversion: 2.20 time: 0.232754 Sep 07 13:17:00.233734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 546/1078] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 13:16:59 2022] POST /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:17:00.254827 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:00.255829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:00.272493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.273234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.273931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.275023 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.275674 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.276441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.514465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:00.525171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:00.526944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:00.530616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8717e37c-1e5b-4152-ac61-75686edc57e7 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1669 microversion: 2.20 time: 0.289066 Sep 07 13:17:00.531716 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 533/1079] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:00 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:01.577546 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:01.580014 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:01.590760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.591911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.592803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.594492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:01.595391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:01.596108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:01.833196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.847334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.850367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:01.853346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ae0a1364-d9b4-48cc-88e5-760cb2ca504a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1669 microversion: 2.20 time: 0.284023 Sep 07 13:17:01.854737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 547/1080] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:01 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1669 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:02.897982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.899384 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.912722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.913611 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.914490 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.915944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.916824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.917598 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.316258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.331964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.335130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.337505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0a75e3e7-c57d-4024-ba9b-eed0a1310b65 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.447039 Sep 07 13:17:03.338510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 534/1081] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:04.372344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:04.373233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:04.382324 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:04.393161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.393788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.394470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.395607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.396241 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.397015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.663917 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.687581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.690309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.694194 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7afb143c-dbdb-4b0d-a981-69e3db684930 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.328199 Sep 07 13:17:04.706791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 548/1082] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:04 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:05.731598 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.732677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.737190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=46 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:05.749619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.753168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.753168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.753168 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.753763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.754134 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.984585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.006277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.010135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:06.012256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-338d0464-b59c-4791-94a1-e543578a8c5c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.286752 Sep 07 13:17:06.013300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 535/1083] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:07.055512 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.056431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.067244 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.068210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.068995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.070313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.071124 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.071927 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.319860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.336367 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.338470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:07.340344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cb806da7-ff15-4d3b-b2b8-ae107f9fa79f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.289867 Sep 07 13:17:07.341205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 549/1084] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:07 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:08.386433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:08.387569 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:08.398359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.399751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.400761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.402411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:08.403268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:08.404049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:08.651337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.664568 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.667204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:08.669238 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8e2b354e-98c5-468a-b8cf-1b0c20bb13dd tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.290861 Sep 07 13:17:08.670352 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 536/1085] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:08 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:09.711242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.712481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.724305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.724908 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.725779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.727012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.727475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.730001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.982209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.999353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:10.001967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:10.004926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c25c3a6b-2152-4f05-ab3d-c889e5aa7ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.300225 Sep 07 13:17:10.004926 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 550/1086] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:11.042538 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:11.043448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.055768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.056635 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.057273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.058322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.058883 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.059400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.063803 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.301484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.316269 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.319416 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.321640 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-955cafb0-d509-4d76-88c9-c5e9515e9ea0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.284935 Sep 07 13:17:11.322667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 537/1087] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:11 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:12.367622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.368523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.384249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.385257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.386061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.387096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.387841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.388526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.641475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.658762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.661825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.664111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa90c5a7-4252-40fb-950b-9060f5ebf140 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.304720 Sep 07 13:17:12.665308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 551/1088] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:13.729963 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:13.733706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:13.746305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.747214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.747949 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.748990 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.749746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.750510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.017146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.031669 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.034737 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.036957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-22859c52-4ecd-4254-a176-3b27cd635a09 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.316559 Sep 07 13:17:14.038004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 538/1089] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:13 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:15.076626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:15.077747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:15.086484 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.087223 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.087706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.088461 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.088934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.089505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.327628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.338665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.340131 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.341948 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f3797af9-04c7-44df-9972-c276b42b2aeb tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.271657 Sep 07 13:17:15.342719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 552/1090] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:15 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:16.370817 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:16.371677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:16.382346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.385098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.385098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.385098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.385098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.386164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.570170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.584613 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.586599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.587819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-eeda851a-c831-4eae-8f42-553d1483bf5f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.222814 Sep 07 13:17:16.588406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 539/1091] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:16 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:17.617877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.618952 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.629452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.630096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.630806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.631696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.632311 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.632792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.834745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.845263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.847430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.848598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-42495d5e-ad33-4091-ae13-442278b3ece5 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.236966 Sep 07 13:17:17.849217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 553/1092] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:18.876998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.877657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.890167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.893548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.893548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.893548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.893548 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.894500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.130659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.143720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.145274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.146819 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-266442b9-0eff-46b3-847d-f8fc50fea586 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.274372 Sep 07 13:17:19.147701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 540/1093] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:20.186154 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:20.187103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:20.197842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.198387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.198979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.199718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.200418 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.200947 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.414480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.430777 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.432294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.433608 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c2f17c8c-7f1a-4f99-8be0-b1d7c4c604d3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.254498 Sep 07 13:17:20.434514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 554/1094] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:20 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:21.468513 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.469287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.478324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.478970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.479523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.480350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.481200 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.481651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.679874 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.689016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.690535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.691756 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-870dea5a-f0c6-4308-90fd-7b3a3ab6462f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.227446 Sep 07 13:17:21.692450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 541/1095] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:22.723175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:22.724284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:22.736961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.737931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.739036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.743742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.744737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.745527 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.962620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.976523 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.978813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.980852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-14bdad54-e0dc-4633-8aff-1f65c3af7300 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.264058 Sep 07 13:17:22.982104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 555/1096] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:23.142962 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "name": "network-vif-plugged", "status": "completed", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:23.166592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.167081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.167728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.183751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] Creating event network-vif-plugged:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:17:23.190904 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a5ecf8a4-8199-445a-ab88-f62a5e3e2f4e req-ce04a1b0-64f8-4b52-a82a-261b47499605 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159205 Sep 07 13:17:23.191624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 542/1097] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:24.014630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.015441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.023243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.023747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.024218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.025103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.025661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.026125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.212599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.224918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.226889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.228628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5ce26492-1613-4bac-b02f-9132aa6c196f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.218985 Sep 07 13:17:24.229661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 556/1098] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:25.263193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.263929 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.271350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.271838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.272276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.273009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.273457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.273938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.423426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.431898 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.433522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.434804 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cf852526-8a69-4b6c-84c6-efae9005c046 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1727 microversion: 2.20 time: 0.179137 Sep 07 13:17:25.435376 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 543/1099] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:26.461793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:26.465090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:26.471119 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.471602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.472036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.472770 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.473325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.473873 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.626558 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.637140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.637467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.638697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-eba78fc6-5a9a-4950-b9a9-dc493068b0b0 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1714 microversion: 2.20 time: 0.181272 Sep 07 13:17:26.639270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 557/1100] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:26 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1714 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:11.550521 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:11.551195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:11.554144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=17 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:11.554812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=37 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:11.561397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.561927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.562372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.563058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.563501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.563935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.606560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-56cfe919-3b0c-4e4e-8fca-8564e3884a28 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/ips" status: 200 len: 148 microversion: 2.1 time: 0.061324 Sep 07 13:18:11.607160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 544/1101] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:11 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/ips => generated 148 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:12.502505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.503128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.505128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=19 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:12.505819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=79,nova_cell1:UPDATE=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:12.512780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.513277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.513713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.514444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.514904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.515329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.544183 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b929d210-b205-43d2-96b9-268199ef45e1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/ips" status: 200 len: 146 microversion: 2.1 time: 0.046550 Sep 07 13:18:12.544637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 558/1102] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:13.057802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b991d2da-f88c-4be0-b7d6-0211e89b515b"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:13.060124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:13.067651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:13.068139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:13.068580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:13.069285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:13.069774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:13.070201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:13.410024 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b1ea8316-96ae-4fa3-ac85-dc3d8001a31a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "POST /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355731 Sep 07 13:18:13.411127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 545/1103] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:13 2022] POST /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:14.006127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:14.008842 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:14.016195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.016773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.017214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.017989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:14.018475 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:14.018879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.426100 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-96490e2c-308a-4aff-95d1-f3b20fb709b1 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424557 Sep 07 13:18:14.427056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 559/1104] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:13 2022] POST /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:21.268058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:21.268727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:21.276157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.276645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.277083 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.277892 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.278350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.278774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.374234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'services' on Instance uuid 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:21.468529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d2411bfc-df32-4fb7-a7ca-c152cffee6c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments/b991d2da-f88c-4be0-b7d6-0211e89b515b" status: 202 len: 0 microversion: 2.1 time: 0.206607 Sep 07 13:18:21.469171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 546/1105] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:21 2022] DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments/b991d2da-f88c-4be0-b7d6-0211e89b515b => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:21.478390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:21.480708 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:21.488500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.488984 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.489412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.490346 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.490794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.491240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.526138 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e07daff3-3021-4337-ada0-047132272554 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Sep 07 13:18:21.526722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 560/1106] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:21 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:22.540443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:22.543879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:22.553006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.553780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.554394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.555355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:22.556037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:22.556656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:22.607740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-87fcae14-2307-4474-9f06-babd938f55e8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072437 Sep 07 13:18:22.608559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 547/1107] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:22 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:23.628009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:23.631510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:23.642447 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.643109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.643548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.644378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.644710 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.645136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.683360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3402a32c-face-4bec-97ab-f75f2a9fe111 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062940 Sep 07 13:18:23.684056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 561/1108] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:23 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:24.698823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:24.701227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:24.708220 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:24.708811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:24.709253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:24.710019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:24.710477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:24.710899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:24.751524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a34c3ad4-d129-4871-af1a-0f10610840b6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056881 Sep 07 13:18:24.752103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 548/1109] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:24 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:25.767781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.770046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:25.777185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.777706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.778130 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:25.779142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.779595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.780382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:25.813638 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-21844fc6-7767-4104-acc0-290a06188ff1 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050322 Sep 07 13:18:25.814251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 562/1110] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:26.827902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:26.830653 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:26.838065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.838774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.839338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.840638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.841119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.841432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.883477 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e5b302ab-67df-4384-b7ce-c1aaea1a35ca tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060766 Sep 07 13:18:26.884068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 549/1111] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:26 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:27.557783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.558629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:27.568910 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.569781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.570362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.571556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.572180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.572639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.607024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ff073a7d-078c-4eef-b016-42f5bc448ebc tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054895 Sep 07 13:18:27.607610 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 563/1112] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:27.619228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.619748 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:27.626693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.627185 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.627620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.628432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.628867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.629297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.666075 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4a368628-df17-49ad-a0d5-33a708074c36 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85" status: 200 len: 194 microversion: 2.1 time: 0.051099 Sep 07 13:18:27.666740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 550/1113] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:27.899595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.903393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:27.911123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.911762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.912308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.913103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.913881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.914486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.968891 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b966ac64-5a5b-47c8-a812-d7b0f1ab92a0 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073652 Sep 07 13:18:27.970043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 564/1114] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:28.983137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:28.985767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:28.995865 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.996715 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.997513 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.998956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.999761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.000519 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.038413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-18bb9ba5-bb04-4c1f-acc6-995c46ca5c81 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059641 Sep 07 13:18:29.039199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 551/1115] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:28 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:18:29.118561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79716b29-479f-4a92-a0fd-d88cfbf13907"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:29.121700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.131749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.133230 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.133944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.135264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.136003 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.136697 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.136899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.137408 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.143881 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.144380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.144807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.145775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.146414 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.147043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.176157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:29.270472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d4bf523-f454-400b-b555-e3328f146962 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 204 len: 0 microversion: 2.1 time: 0.136676 Sep 07 13:18:29.271116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 552/1116] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:29 2022] DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:18:29.281036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:29.281775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:29.288323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.288845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.289283 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.290014 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:29.291142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:29.291572 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.461772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:29.474117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e673c53f-04bb-4fb5-9ade-07e654d04fb6 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1679 microversion: 2.1 time: 0.197861 Sep 07 13:18:29.474886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 553/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:29 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:30.500167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:30.500933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:30.507549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.508124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.508596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.509438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.509978 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.510427 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.652410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:30.666271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a2b177e0-2c35-4683-bc0c-b6ea51d8a060 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1679 microversion: 2.1 time: 0.169913 Sep 07 13:18:30.667213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 554/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:30 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:30.895993 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-29aac9e5-8cbf-4a81-94de-027ff6501c08 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "POST /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.782604 Sep 07 13:18:30.896975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 565/1119] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:29 2022] POST /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 194 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:31.694412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:31.695205 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:31.705643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.706405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.706839 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.707697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.708266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.708687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.190870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:32.200430 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cc27956c-55e1-4f21-8464-44de89763f01 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1679 microversion: 2.1 time: 0.510866 Sep 07 13:18:32.201260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 555/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:31 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1679 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:32.358774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c56c8e8-883d-4fd0-9f85-6bf176d45b4f", "name": "network-vif-deleted", "tag": "5bd262b4-dffa-4ecf-9712-914e429657ea"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:32.370413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.371165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.371785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.387386 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] Creating event network-vif-deleted:5bd262b4-dffa-4ecf-9712-914e429657ea for instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f on hv-cinder-85331 Sep 07 13:18:32.393164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-f37c4b45-b6c4-409d-b099-095583265212 req-c26d7451-56c0-4a7c-b14f-0be662fc4f98 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039233 Sep 07 13:18:32.397975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 566/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:33.225540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.226187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.240047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.240769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.241262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.242208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.242799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.243484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.290918 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.291661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.292333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.292780 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lazy-loading 'fault' on Instance uuid 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:33.346539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4779abc6024a0f84f041ca7c058e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '317ea4e7108a4fc099da6d76a1793ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:33.351923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:33.359695 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fd2605bc-7ee8-407e-a74b-df2f0a91d880 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 200 len: 1331 microversion: 2.1 time: 0.138232 Sep 07 13:18:33.361330 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 556/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:33 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:33.647822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.650779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.668140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.669158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.669915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.671722 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.672629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.673354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.715656 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-53e1bfba-f8a7-43a0-99ab-41a6b8fdcdc9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075690 Sep 07 13:18:33.716516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 567/1123] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 13:18:33 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:33.797474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.798006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.806171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.806647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.807070 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.807812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.808282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.808703 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.839171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:33.940442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9d1fc32f-23b7-47c1-85de-b90b2c917652 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 204 len: 0 microversion: 2.20 time: 0.147347 Sep 07 13:18:33.941441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 557/1124] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 13:18:33 2022] DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:18:33.952466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.953105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.960261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.961262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.961976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.962687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.963144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.963576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.131920 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.142850 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.144275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.145975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5002a9d5-d6be-4f98-8d21-54cbd0c73dba tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.198593 Sep 07 13:18:34.146443 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 568/1125] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:33 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:18:34.386748 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.387453 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:34.395079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.395680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.396221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.397135 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.397846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.398431 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.416859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f HTTP/1.1 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:34.418552 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:34.421121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '1c56c8e8-883d-4fd0-9f85-6bf176d45b4f'} Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:34.422195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:34.423757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:34.425058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:34.425058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5a21a7cc-58b2-4e90-8a64-84d14fc0cf9e tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 404 len: 111 microversion: 2.1 time: 0.039145 Sep 07 13:18:34.425058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 558/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:34.435496 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ad6d7043-fe40-469a-991e-5355778ba7c8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '.version_select at 0x7fdc41fc9040>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.458111 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ad6d7043-fe40-469a-991e-5355778ba7c8 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588758280" status: 202 len: 0 microversion: 2.1 time: 0.029993 Sep 07 13:18:34.458997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 569/1127] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 13:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588758280 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:18:35.185835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.186338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:35.196382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.197200 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.197850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.198353 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.198891 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.199335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.408861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.418195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.420057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.421248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4d6fdfb6-70f6-4ae2-a754-e75548075a9a tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.240026 Sep 07 13:18:35.421822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 559/1128] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:36.434082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.434812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.442248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.442759 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.443172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.444327 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.445011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.445801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.454211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.455466 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.462349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f HTTP/1.1 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:36.464037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.466687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '1c56c8e8-883d-4fd0-9f85-6bf176d45b4f'} Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:36.468146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.471075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.473794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:36.473794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-51b7b269-d9e7-4a8a-bbac-e05497f1f70a tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 404 len: 111 microversion: 2.1 time: 0.035982 Sep 07 13:18:36.473794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 570/1129] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:36 2022] DELETE /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:36.478925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.479620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.480065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.480433 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.481483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.482275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.482527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.483045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.495729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.496617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.497565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.499148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.499988 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.500814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.530936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f HTTP/1.1 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:36.533985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.535617 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '1c56c8e8-883d-4fd0-9f85-6bf176d45b4f'} Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:36.536595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. Sep 07 13:18:36.541571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:36.544519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 1c56c8e8-883d-4fd0-9f85-6bf176d45b4f could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:36.544519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e59941a3-a17b-4e75-8868-e943f463105b tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f" status: 404 len: 111 microversion: 2.1 time: 0.064369 Sep 07 13:18:36.544519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 571/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/1c56c8e8-883d-4fd0-9f85-6bf176d45b4f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:36.690566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.711986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.713858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.715661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-da3f1b38-8b96-48f7-a0f7-0d625d1a798f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1720 microversion: 2.20 time: 0.268649 Sep 07 13:18:36.723186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 560/1131] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:37.180579 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fb954-ec5b-4262-b0e0-b2b973da6a25", "name": "network-vif-deleted", "tag": "4e0ba0d2-f32f-402f-8736-b65ebbe8ed50"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:37.191407 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.191991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.192500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.204982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] Creating event network-vif-deleted:4e0ba0d2-f32f-402f-8736-b65ebbe8ed50 for instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 on hv-cinder-85331 Sep 07 13:18:37.212096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-c428e318-db5f-4096-a6aa-7ab7db0f6727 req-6c5b357f-8136-41cb-b00d-a49e223de7de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Sep 07 13:18:37.212804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 572/1132] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:37.781946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.785724 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.798742 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.799660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.800452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.801395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.802064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.802677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.834214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.836254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.851387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.853319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.854437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.856117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.857085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.860127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.886469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c HTTP/1.1 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:37.888921 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.893263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'fccb0d34-170a-4797-8443-06083751ad8c'} Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:37.894481 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.896847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.898382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:37.898382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bf4ef0c5-cf11-4b05-b6f9-a0c20c580522 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 404 len: 111 microversion: 2.1 time: 0.065157 Sep 07 13:18:37.898700 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 573/1133] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:37 2022] DELETE /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:37.908492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.908492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: fccb0d34-170a-4797-8443-06083751ad8c] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.912630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.915819 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.916088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.916625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.917465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.918024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.918642 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.929612 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.933945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.936312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a34ae61d-b2e8-4d16-a201-a24342977d9f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1365 microversion: 2.20 time: 0.174711 Sep 07 13:18:37.937191 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 561/1134] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:18:37.940393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c HTTP/1.1 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:37.942166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.944480 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'fccb0d34-170a-4797-8443-06083751ad8c'} Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:37.946248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. Sep 07 13:18:37.949044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.951825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance fccb0d34-170a-4797-8443-06083751ad8c could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:37.951825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8b37b06d-7e74-4595-b260-9769f4f56d7c tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c" status: 404 len: 111 microversion: 2.1 time: 0.042169 Sep 07 13:18:37.951825 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 574/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/fccb0d34-170a-4797-8443-06083751ad8c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:18:37.955659 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.956268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:37.963131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.963763 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.966369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.966369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:37.966369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:37.966369 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:37.981923 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 HTTP/1.1 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:37.984474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:37.987845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '557046c4-53f5-4652-abb6-20ae0c1143f0'} Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:37.989607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:37.992752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:37.995332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:37.995332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-09aee63e-49e6-41f9-8eff-2fae2cada7c5 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 404 len: 111 microversion: 2.1 time: 0.035232 Sep 07 13:18:37.995332 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 562/1136] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:37 2022] DELETE /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:38.001897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.003028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 557046c4-53f5-4652-abb6-20ae0c1143f0] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.010855 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.011449 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.011886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.013529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.014036 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.014471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.032453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 HTTP/1.1 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:38.034313 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:38.037268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '557046c4-53f5-4652-abb6-20ae0c1143f0'} Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:38.039164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. Sep 07 13:18:38.041757 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:38.044289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 557046c4-53f5-4652-abb6-20ae0c1143f0 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:38.044289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-443983c9-d1ac-4667-86c1-623e3b0fb203 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0" status: 404 len: 111 microversion: 2.1 time: 0.042035 Sep 07 13:18:38.044289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 575/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/557046c4-53f5-4652-abb6-20ae0c1143f0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:38.966539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.967319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.975366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.976378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.976378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.977065 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.977606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.978260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.018603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.019149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.019627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.020367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lazy-loading 'fault' on Instance uuid cb8fb954-ec5b-4262-b0e0-b2b973da6a25 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:39.080946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.098850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.100623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5235207aa3b5477eb76215ebb4a43c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1959b8e00bc4819a993fdbd0c012f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.101872 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-142687da-9ad0-4aca-85a9-f234c68f14d9 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 200 len: 1370 microversion: 2.20 time: 0.140945 Sep 07 13:18:39.102434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 563/1138] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:39.254806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.255668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.266500 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.267000 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.267442 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.268154 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.268604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.269024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.285259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 HTTP/1.1 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:39.286893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.288576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '220b5e26-01bc-4cee-83b3-abe0a93330b4'} Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:39.290012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.292268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.295071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:39.295071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e25fb98e-8fac-434b-bd03-e8439430be43 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 404 len: 111 microversion: 2.1 time: 0.039657 Sep 07 13:18:39.295071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 576/1139] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:39 2022] DELETE /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:39.301441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.302112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] [instance: 220b5e26-01bc-4cee-83b3-abe0a93330b4] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.309027 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.309518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.309994 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.310712 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.311169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.311615 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.327046 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] HTTP exception thrown: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Request method failure captured: Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 HTTP/1.1 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJdY-c5E7kr5m2UIJclL-JaWfK6pYIrQ2ZTthPD9Wi4atHTYqW_YKMglSR5tdAqP-e91c5svnzFIOsev0sXjiAx-1i2-ntLL1m1oVFFYZWwSq_bwxsUXTT-jTStNAJ_4701TUCFtdUgog-sKV8pttLovCqxjsvFJm45hc36JPm5v9uY Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:39.328730 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_317ea4e7108a4fc099da6d76a1793ac9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/317ea4e7108a4fc099da6d76a1793ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 317ea4e7108a4fc099da6d76a1793ac9 Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-881021537 Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: ca4779abc6024a0f84f041ca7c058e9a Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeNegativeTest-881021537-project Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.331541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '220b5e26-01bc-4cee-83b3-abe0a93330b4'} Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:39.332998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. Sep 07 13:18:39.334814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.336607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] Returning 404 to user: Instance 220b5e26-01bc-4cee-83b3-abe0a93330b4 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:39.336607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dc865274-e846-4ef6-80e6-951a341a56e4 tempest-AttachVolumeNegativeTest-881021537 tempest-AttachVolumeNegativeTest-881021537-project] 10.222.0.17 "GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4" status: 404 len: 111 microversion: 2.1 time: 0.036751 Sep 07 13:18:39.336607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 564/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/220b5e26-01bc-4cee-83b3-abe0a93330b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:39.703160 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.705408 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.711902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.712394 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.712878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.713570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.714079 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.714507 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.753496 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c4be352b-d10e-4fa1-81f1-9f6f7992272f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054712 Sep 07 13:18:39.754592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 577/1141] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:39.906594 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.907111 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.914752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.915413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.915862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.916868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.917689 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.918580 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.961751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-230c604c-519a-419b-b1de-d7a367e5538b tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85" status: 200 len: 194 microversion: 2.1 time: 0.060618 Sep 07 13:18:39.962397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 565/1142] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:39.973847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.974639 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.981502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.982141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.982590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.983312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.983773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.984197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.007387 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:40.095503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lazy-loading 'services' on Instance uuid 9439d387-3f56-4965-bc16-3605c1377ced {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:40.128701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.129328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.138499 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.139358 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.139980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.140772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.141300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.141870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.165864 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 HTTP/1.1 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:40.167794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:40.170356 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'cb8fb954-ec5b-4262-b0e0-b2b973da6a25'} Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:40.171537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:40.175186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:40.179802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:40.179802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-183ba0e1-fc3a-4188-86cc-8b170603d163 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 404 len: 111 microversion: 2.20 time: 0.045633 Sep 07 13:18:40.179802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 566/1143] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:18:40.181661 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8bcb89e8-526d-4997-8763-b114958a053f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '.version_select at 0x7fdc41f87430>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.193005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4d9f3930-d7bc-4931-9125-cea0bb8bc2ee tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85" status: 202 len: 0 microversion: 2.1 time: 0.222680 Sep 07 13:18:40.194252 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 578/1144] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:39 2022] DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/75cfe2d9-1ce3-4262-bb8b-a3ce72e76d85 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:40.214109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8bcb89e8-526d-4997-8763-b114958a053f tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289900407" status: 204 len: 0 microversion: 2.20 time: 0.036201 Sep 07 13:18:40.217563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 567/1145] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Sep 7 13:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289900407 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:18:42.399253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.400091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.410043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.410925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.411371 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.412102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.412564 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.412989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.432612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 HTTP/1.1 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:42.434344 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.437118 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'cb8fb954-ec5b-4262-b0e0-b2b973da6a25'} Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:42.438683 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.440748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.443253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:42.443253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b40f2a7d-69af-43c1-b1a8-9b2bc62696e1 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 404 len: 111 microversion: 2.20 time: 0.044704 Sep 07 13:18:42.443253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 579/1146] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 13:18:42 2022] DELETE /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:18:42.445573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.446312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cb8fb954-ec5b-4262-b0e0-b2b973da6a25] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.451287 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:42.457831 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.458432 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.458743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.459478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.459996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.460394 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.479681 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 HTTP/1.1 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:42.481363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.483246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'cb8fb954-ec5b-4262-b0e0-b2b973da6a25'} Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:42.484362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. Sep 07 13:18:42.486364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.488076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cb8fb954-ec5b-4262-b0e0-b2b973da6a25 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:42.488076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f9d8c268-bc11-4729-8c42-163e0123350c tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25" status: 404 len: 111 microversion: 2.20 time: 0.041364 Sep 07 13:18:42.488076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 568/1147] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/cb8fb954-ec5b-4262-b0e0-b2b973da6a25 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:18:42.520870 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.521382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.526474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:42.532520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.533024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.533652 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.535173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.535857 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.537748 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.593693 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a4434e3b-9310-4635-aa65-77846f4610e8 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/79716b29-479f-4a92-a0fd-d88cfbf13907" status: 200 len: 194 microversion: 2.1 time: 0.078293 Sep 07 13:18:42.604288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 580/1148] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/79716b29-479f-4a92-a0fd-d88cfbf13907 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:42.613156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.614522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.624894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.625879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.626844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.627867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.628591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.629246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.749862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lazy-loading 'services' on Instance uuid 9439d387-3f56-4965-bc16-3605c1377ced {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:42.865907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-20d09625-77ec-4164-b093-26d50dbf9155 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/79716b29-479f-4a92-a0fd-d88cfbf13907" status: 202 len: 0 microversion: 2.1 time: 0.259129 Sep 07 13:18:42.866542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 569/1149] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:42 2022] DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments/79716b29-479f-4a92-a0fd-d88cfbf13907 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:43.751427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.752389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.760661 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.761150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.761954 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.763165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.764077 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.764746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.790622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef HTTP/1.1 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:43.793626 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.796765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'cd384fa3-24c0-47a6-8dc5-f6ad179994ef'} Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:43.803490 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.807967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.815383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:43.815383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-335361c2-801c-4a62-9bd8-7960b47d18c3 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 404 len: 111 microversion: 2.20 time: 0.049898 Sep 07 13:18:43.815383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 581/1150] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 13:18:43 2022] DELETE /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:18:43.816393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.816393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] [instance: cd384fa3-24c0-47a6-8dc5-f6ad179994ef] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.832985 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.834706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.835342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.836421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.836942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.837372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.865561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] HTTP exception thrown: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Request method failure captured: Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef HTTP/1.1 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJda4OlEH7kttzeRd7DVbMMm5eunmfWMWtbFr2ZeUE6krv91uzKKh4SZxdxFozWRZItBhdhYdpH8NORsYPSkuswgRnB160HsbwVTwzP_ur7tm2sfgwqLy-AgWdhrsfY6oUyYhiLNa2QUUCCqP2wY83OumYekbfzZD7N_ts-E_VM4Zas Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:43.867885 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1959b8e00bc4819a993fdbd0c012f5c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1959b8e00bc4819a993fdbd0c012f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: f1959b8e00bc4819a993fdbd0c012f5c Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-256770887 Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 5235207aa3b5477eb76215ebb4a43c98 Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-256770887-project Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.871899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'cd384fa3-24c0-47a6-8dc5-f6ad179994ef'} Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:43.872794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. Sep 07 13:18:43.874109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:43.875284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] Returning 404 to user: Instance cd384fa3-24c0-47a6-8dc5-f6ad179994ef could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:43.875284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f4022644-616d-452d-9d49-3ea06244a521 tempest-AttachVolumeShelveTestJSON-256770887 tempest-AttachVolumeShelveTestJSON-256770887-project] 10.222.0.17 "GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef" status: 404 len: 111 microversion: 2.20 time: 0.066420 Sep 07 13:18:43.875284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 570/1151] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:43 2022] GET /compute/v2.1/servers/cd384fa3-24c0-47a6-8dc5-f6ad179994ef => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:18:44.186786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:44.189860 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.200714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.201506 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.202253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.203365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.204925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.205916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.260269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e7f3f998-0305-4a04-9395-f6fd825f0a21 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084522 Sep 07 13:18:44.260852 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 582/1152] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:44 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:18:44.442236 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:44.444966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.451886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.452355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.452798 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.453720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.454176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.454602 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.493234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b2446b28-1a5a-4b54-a067-fdb78d94d824 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055619 Sep 07 13:18:44.496922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 571/1153] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:44 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:18:44.577581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:44.578159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.586976 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.587739 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.588170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.589062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.589647 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.590096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.630236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:44.757315 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ca4a69f4-fb7d-4fd6-91ee-e232def7befd tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 204 len: 0 microversion: 2.1 time: 0.186613 Sep 07 13:18:44.762329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 583/1154] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:44 2022] DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:18:44.767858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:44.768867 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.782170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.783399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.784475 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.786099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.787229 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.788187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:45.082382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:45.091774 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d3443371-6d95-4e4d-b817-ad6b00f06b92 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1674 microversion: 2.1 time: 0.328562 Sep 07 13:18:45.092377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 572/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:44 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1674 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:46.125403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:46.128031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:46.142901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.145105 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.146214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.148217 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.149373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.151167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.396702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:46.408357 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9541174f-42de-44ba-adc1-c16a610fde01 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1674 microversion: 2.1 time: 0.293564 Sep 07 13:18:46.412310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 584/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:46 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1674 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:47.441246 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:47.442367 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:47.459941 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.461146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.462816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:47.464121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:47.465911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:47.466762 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:47.644959 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ee30d72b-5427-4392-9264-22799dd368d9 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41f7fdc0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:47.705219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:47.718066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ee30d72b-5427-4392-9264-22799dd368d9 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b4afc05d-0ccc-41a2-83e0-b8438f00a379" status: 200 len: 351 microversion: 2.1 time: 0.082402 Sep 07 13:18:47.718327 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-776b89e8-2d5d-4aa3-a146-e28334ff11eb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1674 microversion: 2.1 time: 0.282865 Sep 07 13:18:47.718821 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 573/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:47 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:47.719595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 585/1158] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:47 2022] GET /compute/v2.1/os-volumes/b4afc05d-0ccc-41a2-83e0-b8438f00a379 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:48.744237 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:48.745069 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:48.754094 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.754747 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:48.755248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.756515 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.757045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:48.757779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.849957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:48.877706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-00b4522d-8016-479a-85aa-a881c466358d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1606 microversion: 2.1 time: 0.127413 Sep 07 13:18:48.877706 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 574/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:48 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:49.060800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439d387-3f56-4965-bc16-3605c1377ced", "name": "network-vif-deleted", "tag": "35fde959-4a97-4d9d-9a82-e0c3b3b61f75"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:49.087521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.088028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.088793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.107221 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] Creating event network-vif-deleted:35fde959-4a97-4d9d-9a82-e0c3b3b61f75 for instance 9439d387-3f56-4965-bc16-3605c1377ced on hv-cinder-85331 Sep 07 13:18:49.113643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-31e1d141-2704-4473-82c3-97ac13ad3fb8 req-ee198a3c-0685-4511-a49b-0b8a212d8192 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059292 Sep 07 13:18:49.114294 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 586/1160] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:49.403399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9d28ce6d-5521-4e6b-a5f3-d7f00226d90e tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc420b58b0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.506616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9d28ce6d-5521-4e6b-a5f3-d7f00226d90e tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6461ab7a-eada-454c-bb69-43c51b69d9a0" status: 200 len: 350 microversion: 2.1 time: 0.112206 Sep 07 13:18:49.507382 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 575/1161] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/os-volumes/6461ab7a-eada-454c-bb69-43c51b69d9a0 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:49.907378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.908143 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:49.943980 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.946949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.954202 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.957936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.962469 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.963210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.049822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.051392 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.052391 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.053404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lazy-loading 'fault' on Instance uuid 9439d387-3f56-4965-bc16-3605c1377ced {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:50.175035 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30153f2f99424f29afaf718784c9f6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fcaf2f89d4438947508dee3737cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:50.208094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7a9d7f87-ee33-4f2b-83da-71b6e80e925d tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 200 len: 1327 microversion: 2.1 time: 0.308587 Sep 07 13:18:50.209129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 587/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 1327 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:51.250530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.251657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:51.261603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.262201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.262654 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.263395 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:51.263869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:51.264305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:51.282494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced HTTP/1.1 Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:51.284359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:51.287268 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '9439d387-3f56-4965-bc16-3605c1377ced'} Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:51.288769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:51.291350 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:51.293905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:51.293905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5a9e7b6d-6846-48c3-9b8d-68bcda86dbaf tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 404 len: 111 microversion: 2.1 time: 0.043017 Sep 07 13:18:51.293905 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 576/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:51.302377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bb1a6cd2-73c6-49b3-bf45-531191bc73e0 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '.version_select at 0x7fdc41fc9790>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.303743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1c08f642-1d29-4633-a544-bb81f5b81099 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41f64a60>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.332043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bb1a6cd2-73c6-49b3-bf45-531191bc73e0 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939648298" status: 202 len: 0 microversion: 2.1 time: 0.038877 Sep 07 13:18:51.332893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 588/1164] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 13:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939648298 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:51.381704 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1c08f642-1d29-4633-a544-bb81f5b81099 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/cbcb77a8-8107-41e6-888b-14d6cabdb60f" status: 200 len: 350 microversion: 2.1 time: 0.082487 Sep 07 13:18:51.382321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 577/1165] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes/cbcb77a8-8107-41e6-888b-14d6cabdb60f => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:51.397203 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-26dd10a0-4d1b-4b42-b026-3377fea48641 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc420135e0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.507489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-26dd10a0-4d1b-4b42-b026-3377fea48641 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.114487 Sep 07 13:18:51.508062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 589/1166] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:51.531334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cbe93961-09bb-45cc-be5f-36f245e06bfa tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc436a3790>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.687397 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cbe93961-09bb-45cc-be5f-36f245e06bfa tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.163083 Sep 07 13:18:51.688337 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 578/1167] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:51.710060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4b79be1e-099c-4854-807a-14b1e7c69e51 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc421d7dc0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.830253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4b79be1e-099c-4854-807a-14b1e7c69e51 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.126990 Sep 07 13:18:51.830939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 590/1168] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:51.854335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6a4674b2-d8bc-466d-92b2-3900112101f7 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41f4fca0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:51.966987 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6a4674b2-d8bc-466d-92b2-3900112101f7 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.118316 Sep 07 13:18:51.968301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 579/1169] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:51.990817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c0957f47-513c-46c9-8447-324aee2bedfb tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41f5fee0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.126189 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c0957f47-513c-46c9-8447-324aee2bedfb tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.141417 Sep 07 13:18:52.127039 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 591/1170] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Sep 7 13:18:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:52.146627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-af6db436-5e1d-4c07-bc5f-67e22c66b196 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc43708700>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.248836 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-af6db436-5e1d-4c07-bc5f-67e22c66b196 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.108554 Sep 07 13:18:52.249787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 580/1171] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Sep 7 13:18:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:52.270363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ad9e5f4b-6a2c-4e3f-87e9-6204830a43a2 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41dab790>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.364707 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ad9e5f4b-6a2c-4e3f-87e9-6204830a43a2 tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098479 Sep 07 13:18:52.365764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 592/1172] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Sep 7 13:18:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:52.386217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-568a5a5f-80a5-4224-8c98-1f7a37e03fea tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] Calling method '.version_select at 0x7fdc41f871f0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:52.544754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-568a5a5f-80a5-4224-8c98-1f7a37e03fea tempest-VolumesTestJSON-1692592068 tempest-VolumesTestJSON-1692592068-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.160140 Sep 07 13:18:52.544754 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 581/1173] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Sep 7 13:18:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:54.753712 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:54.754632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:54.765831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.766706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.767421 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.768510 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.769349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.770222 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.790516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced HTTP/1.1 Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:54.792705 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.796122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '9439d387-3f56-4965-bc16-3605c1377ced'} Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:54.797043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.798583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.800049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:54.800049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d8176a7e-e10c-43fb-b79f-603e18229f98 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 404 len: 111 microversion: 2.1 time: 0.049636 Sep 07 13:18:54.800049 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 593/1174] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:54 2022] DELETE /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:54.804633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:54.805241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 9439d387-3f56-4965-bc16-3605c1377ced] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:54.812765 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.813462 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.813931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.814644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.815106 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.815531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.831723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced HTTP/1.1 Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:54.833309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.836297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '9439d387-3f56-4965-bc16-3605c1377ced'} Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:54.840243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. Sep 07 13:18:54.842692 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:54.845266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 9439d387-3f56-4965-bc16-3605c1377ced could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:54.845266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b44421da-016b-498a-b046-de01adf8cb7f tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced" status: 404 len: 111 microversion: 2.1 time: 0.034735 Sep 07 13:18:54.845266 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 582/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:54 2022] GET /compute/v2.1/servers/9439d387-3f56-4965-bc16-3605c1377ced => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:56.020334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.021224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.029282 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.029879 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.030348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.031210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.031675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.032139 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.050970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b HTTP/1.1 Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:18:56.052591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.054467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '08cc93d9-9e4f-4c6a-adda-4f3f34ac099b'} Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:56.055256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.056803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.058275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:56.058275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bf7ac7ce-bad4-4b1a-8740-a142f2e93cfb tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 404 len: 111 microversion: 2.1 time: 0.037830 Sep 07 13:18:56.058275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 594/1176] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:56 2022] DELETE /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:56.063981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.064749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] [instance: 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.071959 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.072457 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.073085 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.073922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.074380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.074816 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.079537 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:56.091483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] HTTP exception thrown: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Request method failure captured: Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b HTTP/1.1 Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJfrpEpNgwr1yv0AWJjuY0a5s2XZw2FByXcLzO4JaYvUn_qHNmiaf-ToBxgHJa_d8bxMTuGw84KDEQKxBPP9mpeN7kFFc_ffeFsI4Cf4qjXgNPa9S7t3lSYNNp4CCN8aVnrNRjF-05PBHl-KjajzXhFD71fO0yNo74LUmzcpSFe943w Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:18:56.093066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b33fcaf2f89d4438947508dee3737cee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b33fcaf2f89d4438947508dee3737cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: b33fcaf2f89d4438947508dee3737cee Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618043570 Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 30153f2f99424f29afaf718784c9f6b1 Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-AttachVolumeTestJSON-618043570-project Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.095116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '08cc93d9-9e4f-4c6a-adda-4f3f34ac099b'} Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:56.096011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. Sep 07 13:18:56.097622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:18:56.099893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] Returning 404 to user: Instance 08cc93d9-9e4f-4c6a-adda-4f3f34ac099b could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:56.099893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f0d85602-e303-4767-b3ee-54759e991131 tempest-AttachVolumeTestJSON-618043570 tempest-AttachVolumeTestJSON-618043570-project] 10.222.0.17 "GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b" status: 404 len: 111 microversion: 2.1 time: 0.034620 Sep 07 13:18:56.099893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 583/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/08cc93d9-9e4f-4c6a-adda-4f3f34ac099b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:04.079585 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b150d249-ed73-42b7-a9e5-114d4a16cbe7 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Action: 'create', calling method: .version_select at 0x7fdc42013d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1853180741", "metadata": {"Type": "work"}}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:04.615632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b150d249-ed73-42b7-a9e5-114d4a16cbe7 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.760463 Sep 07 13:19:04.616275 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 595/1178] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 13:19:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 762 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:19:04.635735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-484b9660-f2b3-47b7-8b8f-8549fd8d8e25 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc4213e4c0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:04.743731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-484b9660-f2b3-47b7-8b8f-8549fd8d8e25 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 200 len: 353 microversion: 2.1 time: 0.114032 Sep 07 13:19:04.745752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 584/1179] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:04 2022] GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:05.761826 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-26913902-bdfd-4db6-8bc7-a7422ebc5f95 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc41f7f040>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.837161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-26913902-bdfd-4db6-8bc7-a7422ebc5f95 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 200 len: 354 microversion: 2.1 time: 0.079856 Sep 07 13:19:05.838618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 596/1180] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:05.859153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ecc1e3a-53b4-4999-8ac7-a4584e137afd tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc420b5d30>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.952178 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ecc1e3a-53b4-4999-8ac7-a4584e137afd tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 200 len: 354 microversion: 2.1 time: 0.102048 Sep 07 13:19:05.953051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 585/1181] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:05.978200 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c529c70c-eda2-4a97-9cdc-870f0a5e2bbb tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc41e0a160>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.025967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:06.038503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:06.085950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c529c70c-eda2-4a97-9cdc-870f0a5e2bbb tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 202 len: 0 microversion: 2.1 time: 0.113132 Sep 07 13:19:06.087612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 597/1182] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:19:05 2022] DELETE /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:06.095136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=19 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:06.105815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cd9668f5-e46c-4143-936f-fc23fbd5440b tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc4211ad30>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.182768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cd9668f5-e46c-4143-936f-fc23fbd5440b tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 200 len: 353 microversion: 2.1 time: 0.088877 Sep 07 13:19:06.183880 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 586/1183] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:07.206904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b70f6843-9105-464d-8b94-4c1f70de1248 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Calling method '.version_select at 0x7fdc42013430>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:07.248717 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-b70f6843-9105-464d-8b94-4c1f70de1248 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] HTTP exception thrown: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b70f6843-9105-464d-8b94-4c1f70de1248 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Request method failure captured: Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 HTTP/1.1 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJpHYRnappLvvSkK3iE58ayHYJbkfWKkFWx-oKJFvYOL9PKGX9_g6z58urMy1kemXRuWuTwWbk6r1m2osC0nYX4ZCJ-LvsfwhyrVVqGEr1cjO_7LsvaK6ElHVsJPE2nOyCUExwe44T9LQ2Agb_memtOPqEfM4pyiHfInFGKy9porfo0 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 1d8b76b1ffc14768882c073047ce26ea Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesGetTestJSON-173770040 Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:19:07.253209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d8b76b1ffc14768882c073047ce26ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d8b76b1ffc14768882c073047ce26ea", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d8b76b1ffc14768882c073047ce26ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d8b76b1ffc14768882c073047ce26ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesGetTestJSON-173770040 Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 1d8b76b1ffc14768882c073047ce26ea Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesGetTestJSON-173770040 Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesGetTestJSON-173770040-project Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 005be735c503453ebf88cf6f3f57c22b Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesGetTestJSON-173770040-project Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': '3a7d90c2-dfb4-49f3-8458-e51165210b14'} Sep 07 13:19:07.256024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. (HTTP 404) (Request-ID: req-d2e511e1-dbe0-4ae8-9c2a-2e8f059dd611) Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:07.257841 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:07.259794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:19:07.262043 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b70f6843-9105-464d-8b94-4c1f70de1248 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] Returning 404 to user: Volume 3a7d90c2-dfb4-49f3-8458-e51165210b14 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b70f6843-9105-464d-8b94-4c1f70de1248 tempest-VolumesGetTestJSON-173770040 tempest-VolumesGetTestJSON-173770040-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14" status: 404 len: 109 microversion: 2.1 time: 0.057123 Sep 07 13:19:07.264201 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 598/1184] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:07 2022] GET /compute/v2.1/os-volumes/3a7d90c2-dfb4-49f3-8458-e51165210b14 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:09.684359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0b69be40-26e6-4d57-8cd0-2acd1559d96f tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Action: 'create', calling method: .version_select at 0x7fdc41f64a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813615441", "metadata": {"Type": "work"}}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0b69be40-26e6-4d57-8cd0-2acd1559d96f tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 121 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:19:09.693843 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813615441", "metadata": {"Type": "work"}}} Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: Sep 07 13:19:09.696276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-813615441', 'metadata': {'Type': 'work'}}}} Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.697160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:19:09.698714 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:19:09.699910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:19:09.699910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.699910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0b69be40-26e6-4d57-8cd0-2acd1559d96f tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.699910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0b69be40-26e6-4d57-8cd0-2acd1559d96f tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140652 Sep 07 13:19:09.699910 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 587/1185] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 13:19:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:19:09.708384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b20afe62-9a15-433c-baba-ef08d00246ae tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Action: 'create', calling method: .version_select at 0x7fdc42013430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1243131274", "metadata": {"Type": "work"}}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b20afe62-9a15-433c-baba-ef08d00246ae tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 120 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:19:09.713943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1243131274", "metadata": {"Type": "work"}}} Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:19:09.715664 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1243131274', 'metadata': {'Type': 'work'}}}} Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi '0' Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.716609 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:19:09.718251 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:19:09.719549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:19:09.719549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.719549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b20afe62-9a15-433c-baba-ef08d00246ae tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.719549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b20afe62-9a15-433c-baba-ef08d00246ae tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013408 Sep 07 13:19:09.719549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 599/1186] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 13:19:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:19:09.727915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-58b6d379-25a7-4daa-856b-f9819d6a45b3 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Action: 'create', calling method: .version_select at 0x7fdc4224ac10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562874352", "metadata": {"Type": "work"}}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-58b6d379-25a7-4daa-856b-f9819d6a45b3 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 119 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:19:09.732588 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562874352", "metadata": {"Type": "work"}}} Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: Sep 07 13:19:09.734608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1562874352', 'metadata': {'Type': 'work'}}}} Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi '' Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.735671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:19:09.737255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:19:09.738629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:19:09.738629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.738629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-58b6d379-25a7-4daa-856b-f9819d6a45b3 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.738629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-58b6d379-25a7-4daa-856b-f9819d6a45b3 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010652 Sep 07 13:19:09.738629 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 588/1187] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 13:19:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:19:09.745695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fcaf1277-1b3f-47e1-85ff-14da13e23e47 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Calling method '.version_select at 0x7fdc41e2fa60>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.782087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-fcaf1277-1b3f-47e1-85ff-14da13e23e47 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] HTTP exception thrown: Volume tempest-invalid-1260699425 could not be found. Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fcaf1277-1b3f-47e1-85ff-14da13e23e47 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1260699425 HTTP/1.1 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:19:09.785594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Volume tempest-invalid-1260699425 could not be found. Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'tempest-invalid-1260699425'} Sep 07 13:19:09.787262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1260699425 could not be found. (HTTP 404) (Request-ID: req-b07e61d2-bbdd-4f11-acf6-ee5818d114a9) Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.788833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:09.790963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1260699425 could not be found. Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:09.792575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1260699425 could not be found. Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1260699425 could not be found. Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fcaf1277-1b3f-47e1-85ff-14da13e23e47 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 404 to user: Volume tempest-invalid-1260699425 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.793938 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fcaf1277-1b3f-47e1-85ff-14da13e23e47 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1260699425" status: 404 len: 99 microversion: 2.1 time: 0.046431 Sep 07 13:19:09.804070 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 600/1188] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Sep 7 13:19:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1260699425 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:19:09.813096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d4434327-3acf-4d49-8b78-39249b7bf805 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004614 Sep 07 13:19:09.813096 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 589/1189] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Sep 7 13:19:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 13:19:09.824882 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a6181759-748b-4058-9165-0fec1bb06294 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005984 Sep 07 13:19:09.825996 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 601/1190] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Sep 7 13:19:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 13:19:09.842665 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c533658-b86d-4bb0-899f-a731773816a7 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Calling method '.version_select at 0x7fdc4211adc0>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.901426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-8c533658-b86d-4bb0-899f-a731773816a7 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] HTTP exception thrown: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c533658-b86d-4bb0-899f-a731773816a7 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: DELETE /compute/v2.1/os-volumes/0c05b1cc-6f3d-4666-908a-99168788ef4a HTTP/1.1 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:19:09.903377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '0c05b1cc-6f3d-4666-908a-99168788ef4a'} Sep 07 13:19:09.911323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. (HTTP 404) (Request-ID: req-4f99d252-939b-48fc-a7d9-848faa4d25e1) Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.913073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:09.916037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:19:09.918016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8c533658-b86d-4bb0-899f-a731773816a7 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 404 to user: Volume 0c05b1cc-6f3d-4666-908a-99168788ef4a could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8c533658-b86d-4bb0-899f-a731773816a7 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/0c05b1cc-6f3d-4666-908a-99168788ef4a" status: 404 len: 109 microversion: 2.1 time: 0.071973 Sep 07 13:19:09.920240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 590/1191] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 13:19:09 2022] DELETE /compute/v2.1/os-volumes/0c05b1cc-6f3d-4666-908a-99168788ef4a => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:09.936456 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9eebfb89-f8b1-4da8-bbfc-c960203952b9 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Calling method '.version_select at 0x7fdc41f5f430>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.978592 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-9eebfb89-f8b1-4da8-bbfc-c960203952b9 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] HTTP exception thrown: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9eebfb89-f8b1-4da8-bbfc-c960203952b9 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Request method failure captured: Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: GET /compute/v2.1/os-volumes/fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 HTTP/1.1 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJpNxUA0daprLzM0CgzfUEtoCm3miS4afUMRklZ7KpoalzdvLjAGBcTDg4V8aLolKrO6m1OefxDpHGIvRwqZvL1Pd2yhYRXTkGnBxg9QG4lK6wMblGukR80-bYKJpLBMmOoPfh7eJINyCPpqfHLr6Lk_XPw4fsNUngZIk_ByGK5ut88 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:19:09.981805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8c2ed66d91784066b807d2ff34e9808d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8c2ed66d91784066b807d2ff34e9808d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 8c2ed66d91784066b807d2ff34e9808d Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-VolumesNegativeTest-1621534486 Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 6219ba9ad4264feebb8a40e5059ff060 Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-VolumesNegativeTest-1621534486-project Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'fc1931b2-ccd2-4406-b2db-c4aae6e9bd87'} Sep 07 13:19:09.983586 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. (HTTP 404) (Request-ID: req-cb8a8ccd-c5d5-4b59-8206-b0fb77181f38) Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.984582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:09.990492 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:19:09.992577 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9eebfb89-f8b1-4da8-bbfc-c960203952b9 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] Returning 404 to user: Volume fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9eebfb89-f8b1-4da8-bbfc-c960203952b9 tempest-VolumesNegativeTest-1621534486 tempest-VolumesNegativeTest-1621534486-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fc1931b2-ccd2-4406-b2db-c4aae6e9bd87" status: 404 len: 109 microversion: 2.1 time: 0.065902 Sep 07 13:19:09.994657 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 602/1192] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:09 2022] GET /compute/v2.1/os-volumes/fc1931b2-ccd2-4406-b2db-c4aae6e9bd87 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:20:10.805693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-cd250ce2-7df3-414d-83c7-ac43818cafeb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'create', calling method: .version_select at 0x7fdc420eac10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1912407060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUmKWp/qjgJMWpDPBLU0FEMp/ppAqZBx7y8jPomNAcLiHWgBq+ay/mWo2W4dIkbb5fy1AzT+EGwp6W2XLv+8/YWafSz9ackpoy3To35wLB9MWbTsBpCaxqPNNtEogVA2Q=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:10.826663 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-cd250ce2-7df3-414d-83c7-ac43818cafeb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Getting quotas for project 5f20e431b2b140ebb7c895ebd5954f67. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:10.834189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-cd250ce2-7df3-414d-83c7-ac43818cafeb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Getting quotas for user 3c5f2dea7bab4b83b09c0c61b21e9700 and project 5f20e431b2b140ebb7c895ebd5954f67. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:10.876529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-cd250ce2-7df3-414d-83c7-ac43818cafeb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.077657 Sep 07 13:20:10.881727 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 591/1193] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:20:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:11.118065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:20:11.119046 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Sep 07 13:20:11.129787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2036675693", "imageRef": "5034c012-f83a-4200-945d-67e2a1408ba4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1912407060", "networks": [{"uuid": "f52990d7-042f-4a63-be13-e633fd9c9556"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:11.232847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] validate_networks() for [('f52990d7-042f-4a63-be13-e633fd9c9556', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:20:12.026646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:20:12.027056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:20:12.027856 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:20:12.028455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:20:12.028990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:20:12.040565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.041060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.041537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.042310 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.042758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.043364 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.071968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Getting quotas for project 5f20e431b2b140ebb7c895ebd5954f67. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:12.079373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Getting quotas for user 3c5f2dea7bab4b83b09c0c61b21e9700 and project 5f20e431b2b140ebb7c895ebd5954f67. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:12.094295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:20:12.096743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5034c012-f83a-4200-945d-67e2a1408ba4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:20:12.165580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e4732097-a310-43a1-bc75-10a63b0eef7a tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051320 Sep 07 13:20:12.166890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 603/1194] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:20:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:20:12.182165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-9790e28c-8653-4146-ae59-b68799b52cf1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:12.183996 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-9790e28c-8653-4146-ae59-b68799b52cf1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:12.274683 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-9790e28c-8653-4146-ae59-b68799b52cf1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.286546 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-9790e28c-8653-4146-ae59-b68799b52cf1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1259 microversion: 2.1 time: 0.109073 Sep 07 13:20:12.287542 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 592/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:12 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1259 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:13.317196 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:13.324157 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:13.342180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.343401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.344264 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.346047 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.347016 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.347864 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.465240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:13.484601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-297fe788-359a-42bd-8d07-b3f4c2c92c4e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1311 microversion: 2.1 time: 0.175770 Sep 07 13:20:13.485457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 604/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:13 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:14.519649 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:14.520928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:14.555275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.556566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.557009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.558272 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.559054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.559494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.707401 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.725440 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ac1428c4-acea-46d3-bee2-0fca994503e4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1317 microversion: 2.1 time: 0.213176 Sep 07 13:20:14.726563 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 593/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:14 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:15.759152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:15.761056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:15.776872 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.777831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.778621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.779907 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.780845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.781526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.161257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.180766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-dae2d549-f06d-4950-8f63-d647986d8a17 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.428450 Sep 07 13:20:16.181559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 605/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:15 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:17.220238 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:17.222341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:17.236197 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.237309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.237970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:17.239309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.239998 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.240424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:17.470154 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:17.486402 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a7f5f216-eb88-4a56-a111-e08206096df5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.271638 Sep 07 13:20:17.487335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 594/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:17 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:18.525593 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:18.526376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:18.537643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.538155 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.539307 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.540209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.540529 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.540949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.787741 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.805594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-41f49c57-2a74-467d-8c32-b0e68972e4fe tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.286247 Sep 07 13:20:18.817316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 606/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:18 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:19.843473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:19.844145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:19.853708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.854209 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.854620 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.855339 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.855799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.856218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.046393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:20.060423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5714ff69-911e-40a9-97c3-463cfe4ef2cb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.220851 Sep 07 13:20:20.062443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 595/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:19 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:21.095061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:21.097365 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:21.104265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:21.104768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:21.105212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.105978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:21.106438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:21.106866 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.257259 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.266083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-83197530-de13-4520-bfd5-7e8fdbfcb6c5 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.175730 Sep 07 13:20:21.266677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 607/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:21 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:22.292847 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:22.294054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:22.296361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:22.302101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.302603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.303049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.303766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.304227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.304650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.511193 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.533311 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fca77eef-7aa2-4290-978d-4606fc36098b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.244211 Sep 07 13:20:22.534306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 596/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:22 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:23.562995 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:23.564437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:23.573950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.575478 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.580308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.580965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.581707 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:23.582543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.583134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.583650 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:23.857895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:23.881445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-be93dd47-7758-4655-97f9-22cf236007d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.325785 Sep 07 13:20:23.882247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 608/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:23 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:24.909937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:24.910947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:24.918842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:24.919722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.919915 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:24.920540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:24.920992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.921417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.130127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.143409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a627e4ce-c03a-4ed9-908f-f8a0074a7611 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.238597 Sep 07 13:20:25.145736 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 597/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:24 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:26.177424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:26.180351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:26.190631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.191140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.191576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.192834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.192834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.193219 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.354297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:26.368568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-89513595-8b08-49c6-940e-32c3ac07a385 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.200500 Sep 07 13:20:26.369487 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 609/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:26 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:27.416873 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:27.417738 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:27.424930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.425425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.425902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.426617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.427073 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.427501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.615224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:27.624989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-62ac30dd-4879-4cd8-864d-392d10320041 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.212146 Sep 07 13:20:27.625575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 598/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:27 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:28.652381 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:28.654226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:28.663949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.664658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.664658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.665425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.665863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.666455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.838933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:28.847813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-153f227e-4b5f-4a32-9664-d2b376a6af8d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.202674 Sep 07 13:20:28.848763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 610/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:28 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:29.883441 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:29.884699 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:29.896895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:29.897933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:29.898887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:29.900100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:29.900931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:29.901528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.087596 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.104159 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5072e297-085a-42f0-90f0-9e53f6a006e8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.225519 Sep 07 13:20:30.105061 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 599/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:29 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:31.142181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:31.142181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:31.145707 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.146728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.148191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.150226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.150226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.152099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.371619 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.384094 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c5a5419c-959b-48f4-8688-34a5bde44e03 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.256419 Sep 07 13:20:31.385013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 611/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:31 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:31.428313 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:31.441389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.441914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.442346 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.457110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] Creating event network-changed:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:20:31.463223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a82e7ba3-5dbd-437a-b45f-9f7af814d4d2 req-ac87977e-858c-4162-b15b-98d72efe21ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283985 Sep 07 13:20:31.463851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 600/1211] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:32.414403 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:32.417731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:32.426062 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.426603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.426951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.427653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.428104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.428520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.587752 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:32.596780 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1ae1001d-32a7-46d0-8212-495e5ab03b80 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.186834 Sep 07 13:20:32.597467 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 612/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:32 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:33.625460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:33.626362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:33.633423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.633942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.634377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.635079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:33.635526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:33.635961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.793426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:33.802590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b4261e52-4dea-4828-98eb-21194ec28f3c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.182099 Sep 07 13:20:33.803288 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 601/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:33 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:34.827395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:34.828335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.834777 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.835268 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.836242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.836442 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.836853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.838637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.983549 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.992698 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fabd0170-bdff-4925-8f39-3a055ec47795 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.169183 Sep 07 13:20:34.993302 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 613/1214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:34 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:36.016514 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:36.017247 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:36.028770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.029273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.029745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.030471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.030925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.031349 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.202687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:36.211208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7f608946-4638-4396-a269-258babf44d15 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.198852 Sep 07 13:20:36.211802 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 602/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:36 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:37.235589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.236288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.243319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.243803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.244236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.244944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.245399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.245863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.395805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.405006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-972d1028-393e-4223-a52c-845c001dffce tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.173467 Sep 07 13:20:37.405655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 614/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:37 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:38.430484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:38.431587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:38.442379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.443195 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.443951 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.445243 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.446109 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.446886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.642047 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.652104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-476bb0f0-39b1-4f40-96aa-e9d3e122734d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.226727 Sep 07 13:20:38.652937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 603/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:39.688309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.689106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:39.699985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.700871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.701525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.702813 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.703637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.704285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.871916 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.884439 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-34de168e-fbc0-43f6-9099-f4355859db1c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.201059 Sep 07 13:20:39.885278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 615/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:39 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:40.911644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:40.912255 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.914869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:40.921078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.921570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.922037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.922755 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.923212 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.923633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.927411 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=63 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:41.088722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.098718 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-46039da0-5670-427f-8dc5-7128171be5fb tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.191156 Sep 07 13:20:41.099308 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 604/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:40 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:42.125655 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:42.126703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:42.129810 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:42.137580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.138635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.139243 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:42.140052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.140765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.141388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:42.145797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=75 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:42.331423 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:42.341385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f2e26706-0ef5-4b3e-81cd-53b188d4b699 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.220258 Sep 07 13:20:42.342134 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 616/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:42 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:43.372147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:43.372893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:43.380011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.380527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.380964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.381710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.382169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.382645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.533956 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.543547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2fa535f5-0b8d-4ed6-a0f2-caaf617136c7 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.175852 Sep 07 13:20:43.544799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 605/1221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:43 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:44.571470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:44.572176 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:44.582052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.582997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.583807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.584881 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.585364 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.585827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.765468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.781234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-38cca340-b6ab-447c-865e-97daabed473d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.213044 Sep 07 13:20:44.782316 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 617/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:44 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:45.812370 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:45.813787 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:45.826456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.827347 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.828108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.829359 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.830200 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.830934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.016917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.029276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c335242f-bad2-406f-8c50-a429cc72af60 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.226064 Sep 07 13:20:46.029878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 606/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:45 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:47.060580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:47.061455 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:47.070573 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.071399 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.071616 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.072623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.073110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.074695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.226519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:47.236601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e79de963-d2c9-4c4b-9441-30fc1beaa557 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.179322 Sep 07 13:20:47.236601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 618/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:47 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:48.261005 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:48.261851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:48.269935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:48.270577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:48.271094 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.272122 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:48.272855 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:48.273406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.447610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.458208 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5251aa03-aa4f-403c-ac18-2c1f16cc0e10 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.202267 Sep 07 13:20:48.459426 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 607/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:48 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:49.494526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:49.504166 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:49.506766 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.508141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.508141 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.509903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.509903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.510298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.761833 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:49.775061 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-31a2c095-105f-42ca-8683-ddfc6d25787f tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.287314 Sep 07 13:20:49.775968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 619/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:49 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:50.725795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "name": "network-vif-plugged", "status": "completed", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:50.740005 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.741221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.741875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.757328 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] Creating event network-vif-plugged:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:20:50.767545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-cf50edbb-2fb1-4614-bb50-e5c7dc4426f0 req-4db700bb-a2b9-4890-8ff6-c7b4a3ee31ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045300 Sep 07 13:20:50.768657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 608/1227] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:50.805603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:50.806531 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:50.828421 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.829190 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.829805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.830802 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.831468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.834426 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.095675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.105939 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2a34bed1-f2e7-4faa-9a35-e740453d9786 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.305300 Sep 07 13:20:51.107156 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 620/1228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:50 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:52.140354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:52.141612 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:52.153361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.154413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.155152 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.156407 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.157354 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.158076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.347377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.356438 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a439db10-a71f-494b-ad09-aced988091ec tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1359 microversion: 2.1 time: 0.226883 Sep 07 13:20:52.356977 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 609/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:52 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:53.384102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:53.384102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:53.396794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.398086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.399191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.400491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.401370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.402161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.663454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:53.673373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b1dd9e16-e619-40c1-baf8-48924a1360fa tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1550 microversion: 2.1 time: 0.294081 Sep 07 13:20:53.675071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 621/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:53 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:53.709589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:53.710618 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:53.718801 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.719636 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.720410 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.721651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.722547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.723292 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.072016 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.082436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6ac4e019-f074-48ea-84fc-fec6abc2b162 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1550 microversion: 2.1 time: 0.379956 Sep 07 13:20:54.083413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 610/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:53 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1550 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:54.121065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:54.130022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.131114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Searching by: {'deleted': False, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67'} {{(pid=120817) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:20:54.142300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.143185 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.143771 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.144968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.146044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.146982 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.304470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.multi_cell_list [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120817) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:20:54.414430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cc9c7265-a157-433c-9825-31052f6b4e50 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.300310 Sep 07 13:20:54.415360 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 622/1232] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Sep 7 13:20:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:54.427499 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:54.428326 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:54.435371 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.436276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.436889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.438042 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:54.438651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:54.439182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:54.652295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.668450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-18d06a2b-b31d-4a68-ac6a-d753efcabe9e tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1550 microversion: 2.1 time: 0.244807 Sep 07 13:20:54.669039 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 611/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:54 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1550 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:58.780621 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b1443c7-c546-4fea-8f95-db781aae8f1c"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:58.784699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:58.798186 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.799022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.799943 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.801889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.802140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.802922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:59.181195 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1495d35e-3b7b-4c5a-bb01-ef461d44f4f4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408705 Sep 07 13:20:59.182239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 623/1234] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 13:20:58 2022] POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:06.472790 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=15 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:06.475241 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=43 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:07.017805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6af380f4-8921-4426-9f8e-ac7445adab00 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Action: 'create', calling method: .version_select at 0x7fdc41f87550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1075767516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN5DxGJGFrAQ5EJO0s6OT66pKzFBKmaGCFek1uuRpSb07QwVjMnUBU5C+UsdCqrnp/+2mT7YzX7wuO7pRuYuPr7EsjKo/uBkFRJv0a5w+EMrGkDDqf6farUnmNSaJx5tg=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:07.038431 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-6af380f4-8921-4426-9f8e-ac7445adab00 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for project 695a571420de439581eb614b16b327aa. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:07.045902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-6af380f4-8921-4426-9f8e-ac7445adab00 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for user 43a6a0b75e48405ca6385ea62768d4d9 and project 695a571420de439581eb614b16b327aa. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:07.090174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6af380f4-8921-4426-9f8e-ac7445adab00 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.623161 Sep 07 13:21:07.102686 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 612/1235] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:21:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:07.526817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:07.528013 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:07.532331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:07.544556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.545412 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.546226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.547432 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:07.548247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:07.549008 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:07.793791 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:07.804263 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-330943a0-89f5-4840-a647-37ebc13e1e19 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1596 microversion: 2.1 time: 0.287195 Sep 07 13:21:07.816338 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 624/1236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:07 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1596 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:11.501818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:11.526165 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.527044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.527805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.569547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] Creating event network-changed:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:21:11.598372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-3eb6f4f4-e96d-4b14-bec1-a6405440618c req-221d878d-4d9e-4504-80a0-f5cf9a15df41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104812 Sep 07 13:21:11.600219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 613/1237] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:13.694225 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2128832326"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:13.695159 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:13.699066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=18 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:13.704654 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:13.705620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:13.706106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.706829 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:13.707287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:13.708692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.713059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:13.967581 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.network.security_group_api [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Adding security group 7664a2e1-f722-4b39-b023-1bea14987c22 to port 7da56cbc-6ba6-417a-a1a1-4680de5673f2 Sep 07 13:21:14.607122 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5e0e261e-7a47-4371-84de-05e3ec5eaff3 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action" status: 202 len: 0 microversion: 2.1 time: 0.918796 Sep 07 13:21:14.608325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 625/1238] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:21:13 2022] POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:21:14.619333 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:14.620189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:14.628157 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.628875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.629375 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.630412 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.631113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.631752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.634470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:14.653296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.654215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.656175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.679034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] Creating event network-changed:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:21:14.690892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-144e0396-1ea0-412d-a5ef-cb1af51c94b9 req-4921ed54-257f-45b8-a929-344757d8a415 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068695 Sep 07 13:21:14.694075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 626/1239] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:14.991082 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:15.014927 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5627f650-4e07-40ef-93de-f9bbf5d65d37 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1762 microversion: 2.1 time: 0.401816 Sep 07 13:21:15.016090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 614/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:14 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1762 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:33.508382 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:33.509871 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=5 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:33.521086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-183212358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1075767516", "security_groups": [{"name": "tempest-secgroup-smoke-1129617057"}], "block_device_mapping_v2": [{"uuid": "d800c457-6621-4c54-a25a-f93f5f9aa3a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "674af3ef-bd9d-4235-aa7b-956bf30ca542"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:33.631344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:33.632869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:33.634527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=8 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:33.939498 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-dfe323be-f2ff-4de5-ab81-5d4a7196df2e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Action: 'create', calling method: .version_select at 0x7fdc41f87550>, body: {"keypair": {"name": "tempest-TestShelveInstance-706952032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5zOKbqNiWzm6ffde1vTetSqPqsDinr7sNjpdDTYwTeiJthVrD17KHFRfB88HKMWfnfeQdsnFK7qVDo2oxYfN7O07lGPVap9nJkXThyabQe+cOKjoi7jim20uxCRGNysg=="}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:33.965833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-dfe323be-f2ff-4de5-ab81-5d4a7196df2e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Getting quotas for project 628aff1654fc4804bbbec0333d3537b2. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:33.974744 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.quota [None req-dfe323be-f2ff-4de5-ab81-5d4a7196df2e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Getting quotas for user abffc071dfac402087686ed80260f31d and project 628aff1654fc4804bbbec0333d3537b2. Resources: {'key_pairs'} {{(pid=120818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:33.984817 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] validate_networks() for [('674af3ef-bd9d-4235-aa7b-956bf30ca542', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:21:34.030902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-dfe323be-f2ff-4de5-ab81-5d4a7196df2e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.404888 Sep 07 13:21:34.031937 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 615/1241] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 13:21:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:35.042336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:21:35.044643 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:21:35.045485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:21:35.045804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:21:35.046227 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:21:35.067400 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.068486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.070300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.072095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.072795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.073520 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.110055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:35.118153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for user 43a6a0b75e48405ca6385ea62768d4d9 and project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:35.203329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:21:35.206253 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d800c457-6621-4c54-a25a-f93f5f9aa3a5',volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:21:35.450675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cf3e9a4b-a224-4d8f-93b0-72bc8c2c5a52 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.944990 Sep 07 13:21:35.451350 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 627/1242] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:21:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:21:35.465046 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-22c0119f-ccae-4807-8f48-6ef95e07fa56 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:35.465972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-22c0119f-ccae-4807-8f48-6ef95e07fa56 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:35.655931 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-22c0119f-ccae-4807-8f48-6ef95e07fa56 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.666651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-22c0119f-ccae-4807-8f48-6ef95e07fa56 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1094 microversion: 2.1 time: 0.207473 Sep 07 13:21:35.667647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 616/1243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:35 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1094 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:36.692005 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:36.693254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:36.704136 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.704968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.705569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.706618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.707237 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.707660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.796875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:36.806904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6027375b-b285-4f4a-9953-769e119c3db1 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1192 microversion: 2.1 time: 0.118134 Sep 07 13:21:36.806904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 628/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:36 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:37.836671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:37.838163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:37.856917 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.857966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.858833 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.860118 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.861049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.861928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.963037 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:37.973502 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-84d97fe9-f2c5-4170-8c81-274f19a7ee02 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1210 microversion: 2.1 time: 0.143511 Sep 07 13:21:37.974141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 617/1245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:37 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:39.007417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:39.008696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:39.015444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.016031 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.016972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.017398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.017884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.018409 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.080813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea450bd-9c43-41fc-9962-b03258a29052", "tag": "ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:39.100273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.101894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.102413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.114357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] Creating event network-changed:ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf for instance eea450bd-9c43-41fc-9962-b03258a29052 on hv-cinder-85331 Sep 07 13:21:39.119852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-248d740f-5471-445c-87a1-41a5a6e851f8 req-a7455c41-4172-407e-a2d0-7f3e8ba68f1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048600 Sep 07 13:21:39.120449 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 618/1246] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:39.441521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:39.453339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-80e8b4b2-34c4-49aa-b0e6-453818172758 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.456765 Sep 07 13:21:39.461271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 629/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:38 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:40.481700 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:40.483450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:40.494099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:40.494710 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:40.495315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:40.496221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:40.496785 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:40.497301 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:40.644556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:40.655038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6f643922-e798-46db-a4eb-2d3735ac0fe4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.179056 Sep 07 13:21:40.655925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 619/1248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:40 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:41.679744 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:41.680404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:41.690327 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.690756 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.691410 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.692408 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.692968 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.693782 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.857620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:41.868289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-43f6dd0a-2388-4900-a0c5-18b061ebc981 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.193668 Sep 07 13:21:41.869081 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 630/1249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:41 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:42.894822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:42.895503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:42.902993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.903511 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.903907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.904711 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.905162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.905589 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:43.057822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:43.066223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7695a34c-2de6-4fdd-9dc6-1f6a13a995bc tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.175323 Sep 07 13:21:43.066671 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 620/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:42 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:44.090295 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:44.091773 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:44.099042 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.099640 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.100144 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.101024 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.102454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.103128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.266578 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:44.279785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f9080776-5ddf-4d60-9a16-236a2b6e1d18 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.193110 Sep 07 13:21:44.280896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 631/1251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:44 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:45.303726 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:45.304321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:45.311586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.312078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.312522 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:45.313228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.313701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.314131 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:45.479112 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:45.488013 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0f05b32f-9849-4fae-99b3-a9cfc50833a4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.188380 Sep 07 13:21:45.488611 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 621/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:45 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:46.512525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:46.513150 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:46.515659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:46.516318 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:46.522894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:46.523377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:46.523804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:46.524548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:46.524991 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:46.525405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:46.684848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:46.693925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-31631f98-4537-4295-bd48-65a2385e2427 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.185292 Sep 07 13:21:46.694212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 632/1253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:46 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:47.720693 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:47.721357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:47.723518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=6 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:47.730126 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.730634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.731070 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.731778 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:47.732232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:47.732656 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.889140 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:47.898720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8097862b-3d5b-49b7-99f1-96a6ba8907f6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.184268 Sep 07 13:21:47.899478 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 622/1254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:47 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:48.923828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:48.924662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:48.931927 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:48.932422 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:48.932861 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:48.933575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:48.934065 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:48.934483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:49.121714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:49.130671 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-21a2107f-0d9d-4dfb-85c0-d92adc5097f4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.211550 Sep 07 13:21:49.131132 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 633/1255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:48 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:50.158575 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:50.159215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:50.166406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.166899 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.167336 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.168074 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.168530 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.168930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.321720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:50.330092 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e11e441e-ea2a-4d8e-9971-6d9a180ad2d6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.176448 Sep 07 13:21:50.333725 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 623/1256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:50 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:51.351205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea450bd-9c43-41fc-9962-b03258a29052", "name": "network-vif-plugged", "status": "completed", "tag": "ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:51.357288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:21:51.357488 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:21:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 07 13:21:51.357886 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:51.365262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:51.365836 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:51.366575 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:51.367006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.379699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] Creating event network-vif-plugged:ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf for instance eea450bd-9c43-41fc-9962-b03258a29052 on hv-cinder-85331 Sep 07 13:21:51.387060 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-9893888c-da7b-47c3-abb7-d797b5dc4a7e req-9dc79297-d46f-4ed2-b931-2892893cf2ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039956 Sep 07 13:21:51.388627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 634/1257] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:51.394541 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:21:51.394930 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Wed Sep 7 13:21:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 (ip 10.222.0.17) !!! Sep 07 13:21:51.404051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:51.404702 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:51.405059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.406038 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:51.406664 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:51.408018 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.583443 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:51.593149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-94142945-1036-4ca7-aa59-b42a4480293e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.241902 Sep 07 13:21:51.594215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 624/1258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:51 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:52.618214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:52.618925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:52.625753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.626257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.626691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.627471 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.627935 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.628354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.787775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:52.795582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-26abfdff-e7f7-46f5-8491-906dadabc025 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1266 microversion: 2.1 time: 0.182722 Sep 07 13:21:52.796155 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 635/1259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:52 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:53.820079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:53.820723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:53.828734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.829528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.830062 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.830776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.831228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.831644 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.996896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:54.006089 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4bc3b0f9-b6c6-4972-921b-5abd9673aeed tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1454 microversion: 2.1 time: 0.190168 Sep 07 13:21:54.006675 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 625/1260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:53 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:54.030721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:54.031349 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:54.038247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:54.038730 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:54.039161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:54.039990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:54.040438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:54.040915 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:54.203395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:54.212329 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bf30b2b8-ca03-413e-bfa8-a0747d9a8428 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1454 microversion: 2.1 time: 0.185359 Sep 07 13:21:54.212965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 636/1261] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:54 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:56.420495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea450bd-9c43-41fc-9962-b03258a29052", "tag": "ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:56.431201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:56.431766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:56.432262 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.445557 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] Creating event network-changed:ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf for instance eea450bd-9c43-41fc-9962-b03258a29052 on hv-cinder-85331 Sep 07 13:21:56.451144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-74d9e9bd-dffd-4445-837e-1f5bc0337432 req-66057a53-37e4-4789-90cd-18d5326e1908 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037430 Sep 07 13:21:56.452104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 626/1262] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:00.984788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-312524043", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-706952032", "security_groups": [{"name": "tempest-secgroup-smoke-49044675"}], "networks": [{"uuid": "03e90a43-b37d-4a66-97ca-5ac74bd3798d"}], "block_device_mapping_v2": [{"uuid": "ce8e0a47-ad0d-445e-8005-1655052f455d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:01.125133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] validate_networks() for [('03e90a43-b37d-4a66-97ca-5ac74bd3798d', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:22:01.558287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:22:01.558726 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:22:01.559181 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:22:01.559589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:22:01.559992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:22:01.573142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.573658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.574115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.574839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.575483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.576056 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.603859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Getting quotas for project 628aff1654fc4804bbbec0333d3537b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:01.611598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Getting quotas for user abffc071dfac402087686ed80260f31d and project 628aff1654fc4804bbbec0333d3537b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:01.680465 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:22:01.682665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce8e0a47-ad0d-445e-8005-1655052f455d',volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:22:01.842924 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-319c86d2-a22c-4762-89f7-9bc775837dde tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.861952 Sep 07 13:22:01.843497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 637/1263] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:22:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:22:01.856815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-035f6aeb-3a2d-43a0-8059-2af82015cefc tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:01.857503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-035f6aeb-3a2d-43a0-8059-2af82015cefc tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:01.918365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-035f6aeb-3a2d-43a0-8059-2af82015cefc tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:01.925935 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-035f6aeb-3a2d-43a0-8059-2af82015cefc tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1087 microversion: 2.1 time: 0.074395 Sep 07 13:22:01.926698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 627/1264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:01 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:02.948848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:02.949485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:02.957037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:02.957589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:02.958781 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:02.959526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:02.959986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:02.960414 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.032459 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:03.041949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-183bb6f1-72d7-4fd3-a126-2485997e7dc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1185 microversion: 2.1 time: 0.096560 Sep 07 13:22:03.042618 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 638/1265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:02 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:04.070791 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:04.072997 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:04.077746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.092211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.093169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.098989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.101267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.102503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.103500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.114040 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=53 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.315980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:04.326254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca17e8a1-8638-4a87-b4d2-a69c3b9746b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1269 microversion: 2.1 time: 0.263756 Sep 07 13:22:04.328175 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 628/1266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:04 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:04.936370 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:04.942633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.952620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.953113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.953543 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.956889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=61 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:04.967561 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] Creating event network-changed:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:22:04.973801 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-e0d48136-8abd-4aa8-be35-6614fe3912be req-946c1af0-0495-4826-b260-f64674305578 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044792 Sep 07 13:22:04.975116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 639/1267] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:05.355190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:05.355888 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:05.363067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.363609 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.364067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.364766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.365234 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.365641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.531386 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:05.539593 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b99ef7f-f41b-4328-8a5e-b39c3c292870 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.189063 Sep 07 13:22:05.540189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 629/1268] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:05 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:06.564110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:06.565006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:06.573963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.574544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.575055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.575846 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.576380 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.576883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.095473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:07.104528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-4301aa78-6a9e-472f-b6f8-ac686d69d91a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.544821 Sep 07 13:22:07.105117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 640/1269] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:06 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:08.128928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:08.130161 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:08.137520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.138043 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.138484 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.139187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.139637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.140056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.302032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:08.311877 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-13faf23e-319e-4349-8700-932370c4a37d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.186778 Sep 07 13:22:08.312800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 630/1270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:08 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:09.338125 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:09.338774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:09.346167 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.346658 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.347090 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.348022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.348872 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.349297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.493044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:09.501491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f6c87771-f91c-4ba9-b60b-3475b1ec706b tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.167516 Sep 07 13:22:09.502170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 641/1271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:09 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:10.524887 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:10.525826 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:10.532587 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.533050 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.533520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.534240 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.534731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.535132 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.688221 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:10.697955 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e0487af5-80c3-4a31-b46c-78805e608141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.176819 Sep 07 13:22:10.698599 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 631/1272] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:10 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:11.721853 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:11.722607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:11.725250 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:11.725931 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:11.732297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.732790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.733211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.733928 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.734378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.734859 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.883331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:11.891296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-cc8d18cb-c92d-413a-a9a5-31c5ea45b3c1 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.173980 Sep 07 13:22:11.891875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 642/1273] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:11 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:12.917325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:12.918357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:12.920436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:12.926666 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.927357 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.927487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.928204 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.928627 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.929048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.074078 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:13.082258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b155642-41cd-4bc2-af2e-0c34d8d89c24 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.170679 Sep 07 13:22:13.082836 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 632/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:12 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.107050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.108018 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.115811 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.116641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.117086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.118110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.118985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.119417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.268113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:14.276588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-29fbc319-cd40-4a53-936c-5fe58befbc39 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.173400 Sep 07 13:22:14.277339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 643/1275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:14 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:15.304645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:15.305869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:15.315090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.315783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.316362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.317231 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.317701 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.318123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.413644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "name": "network-vif-plugged", "status": "completed", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:15.430108 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.430893 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.431319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.444878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] Creating event network-vif-plugged:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:22:15.450416 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-d7622809-1969-4404-87c0-358d821acaa7 req-f6596be8-0c6c-4506-8e4b-fd0920fb9a46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045089 Sep 07 13:22:15.451368 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 644/1276] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:15.472389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:15.483783 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d8ab1de2-7e0d-479b-a4ad-b39703ac0cd9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.184597 Sep 07 13:22:15.484380 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 633/1277] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:15 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:16.510374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.511180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:16.518646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.519289 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.520358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.520878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.521509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.521786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.667799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.677800 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f61e0dff-955a-43e6-af0a-b7b24e129866 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.173735 Sep 07 13:22:16.678389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 645/1278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:17.702428 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.703190 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.711148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.711800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.712340 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.713196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.713733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.714286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.901289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:17.913271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a2e1774f-8643-4500-bdb0-5d06f050252c tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1257 microversion: 2.1 time: 0.215351 Sep 07 13:22:17.914256 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 634/1279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1257 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:18.943603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.944390 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.953793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.954612 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.955361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.956672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.957568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.958513 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.123728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:19.135927 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fc2ff899-fdf4-4ca2-a52a-97876da34750 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1441 microversion: 2.1 time: 0.197211 Sep 07 13:22:19.136628 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 646/1280] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1441 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:19.161925 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:19.162708 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:19.171469 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.171948 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.172461 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.173072 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.173510 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.173954 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.365624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:19.374348 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-407cec7f-6ef5-4c2a-a421-7d05afbc23e9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1441 microversion: 2.1 time: 0.217004 Sep 07 13:22:19.374945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 635/1281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:19 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1441 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:21.448637 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:21.464544 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.464911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.465353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.479117 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] Creating event network-changed:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:22:21.484958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-49e87ef1-155b-438f-951d-15816b9ed570 req-e672af82-0987-46cc-93d7-faa405effb4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042030 Sep 07 13:22:21.485880 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 647/1282] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:26.234400 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:26.236600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:26.244884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.245479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.246054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.247000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.247657 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.248282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.355526 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b0737e19-6d67-47b8-88e8-94aa33ec7854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action" status: 202 len: 0 microversion: 2.1 time: 0.124422 Sep 07 13:22:26.357130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 636/1283] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:22:26 2022] POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:26.369177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:26.370052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:26.377556 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.378171 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.378812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.379515 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.379999 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.380421 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.611343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:26.623762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-014d839a-c235-4f12-87a4-7ca5c102521c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1754 microversion: 2.1 time: 0.260212 Sep 07 13:22:26.624788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 648/1284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:26 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1754 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:27.652471 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:27.653769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:27.660271 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:27.660757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:27.661186 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.663470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:27.663470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:27.663470 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.826300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.835127 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-198abe00-9c62-46b1-a98f-12a4fa66ca13 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.187743 Sep 07 13:22:27.835696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 637/1285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:27 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:28.860679 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:28.861460 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:28.872803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.873369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.873834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.874909 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.875682 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.876376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.041184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:29.049797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b4f9f0f3-2256-4e3e-99f4-c260b277d1b2 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.192937 Sep 07 13:22:29.050308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 649/1286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:28 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:30.072979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:30.073527 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:30.080033 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.080523 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.081056 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.081788 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.082274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.082673 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.242194 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.250924 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-e8c5a36c-89b4-4292-b61f-d1276e85457d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.181999 Sep 07 13:22:30.251488 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 638/1287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:30 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:31.274787 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:31.275445 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:31.282138 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.282604 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.283044 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.283735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.284306 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.284906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.445440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.454006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a7453b80-6522-41f1-a93e-3461f80317b4 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.183161 Sep 07 13:22:31.454591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 650/1288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:31 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:32.478505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:32.479129 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:32.486248 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.486733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.487322 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.488025 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.488479 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.488895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.651922 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:32.660643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2c2344e6-df23-4c88-9a46-df491546c281 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.185957 Sep 07 13:22:32.661224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 639/1289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:32 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:33.691325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:33.692224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:33.701812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:33.702768 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:33.703286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:33.705261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:33.705261 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:33.708129 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:33.898191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:33.907258 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-a67c4dc7-de40-47e3-b0fd-858aa900e211 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.220343 Sep 07 13:22:33.907854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 651/1290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:33 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:34.935570 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:34.936277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:34.938808 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=24 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:34.945172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:34.945735 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:34.946170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:34.946878 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:34.947316 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:34.947733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:34.951274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:35.118773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:35.129448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f43973da-6032-4a6d-8a7c-5b655ab32839 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.198719 Sep 07 13:22:35.130099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 640/1291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:34 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:36.155696 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:36.156377 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:36.159012 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=26 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:36.165485 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.166025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.166473 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:36.167352 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.167673 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.168704 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:36.171703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=66 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:36.334602 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:36.348978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7cadd99c-c315-4a69-9d7f-b326a898138b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.198420 Sep 07 13:22:36.349998 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 652/1292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:36 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:37.373799 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:37.374773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:37.384063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:37.384814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:37.385991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:37.386219 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:37.386961 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:37.387481 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:37.572571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:37.583228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f844e9f1-3304-4c7d-8472-79eb3fc75a02 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.213748 Sep 07 13:22:37.583826 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 641/1293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:37 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:38.611740 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.613066 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.621140 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.621749 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.622238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.623030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.623532 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.624086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.786374 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:38.795262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ac507f59-04a7-40fa-925d-82baf78b3ea6 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.187857 Sep 07 13:22:38.796672 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 653/1294] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:38 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:39.830733 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:39.831772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:39.838793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.839285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.839720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:39.840429 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.840979 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.841274 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.010610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:40.023544 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-960a12df-0f14-4064-b350-683b16aeeb92 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.198493 Sep 07 13:22:40.024398 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 642/1295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:39 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:41.048071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:41.048747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:41.056703 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.057348 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.057701 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.058590 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.059341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.059886 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.240509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.252175 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-47f31187-cacc-4fca-ac63-4e2fab6f9270 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.207799 Sep 07 13:22:41.252786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 654/1296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:41 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:42.281251 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:42.282459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:42.289399 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.289947 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.290405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.291124 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.291582 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.292003 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.493897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.502879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-05d77db5-187f-4223-802d-8cff2af7f782 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.225666 Sep 07 13:22:42.503607 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 643/1297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:42 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:43.529735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:43.530582 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:43.538688 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.539170 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.539589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.540297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.540762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.541169 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.727807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.750277 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b46dbaf0-03d9-43a2-ad24-56004c717804 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1759 microversion: 2.1 time: 0.225814 Sep 07 13:22:43.751080 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 655/1298] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:43 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:44.780275 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:44.781295 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:44.789143 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.789642 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.790722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.790945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.791286 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.791746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.977813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.993215 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6db84a1a-af5e-477f-b366-93bb99177309 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1762 microversion: 2.1 time: 0.219639 Sep 07 13:22:44.993845 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 644/1299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:44 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1762 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:48.734308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2128832326"}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:48.735292 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:48.738702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=7 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:48.739668 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=23 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:48.753226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:48.753226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:48.753226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:48.753226 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:48.753769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:48.753769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:48.898911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.network.security_group_api [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Removing security group 7664a2e1-f722-4b39-b023-1bea14987c22 from port 7da56cbc-6ba6-417a-a1a1-4680de5673f2 Sep 07 13:23:49.538027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0f75f09b-6e78-4e9e-821b-bc89f977119b tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action" status: 202 len: 0 microversion: 2.1 time: 0.811859 Sep 07 13:23:49.538949 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 656/1300] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:48 2022] POST /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:49.545818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=9 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:49.546600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=29 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:49.547719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:23:49.547875 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Wed Sep 7 13:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 07 13:23:49.553362 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:49.566227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:49.566753 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:49.567187 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:49.580624 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] Creating event network-changed:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:23:49.586104 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-eaf84ac0-f6f6-475c-bb95-795a9e06e7a9 req-a6ef1a5f-21bc-42f3-9607-008cb03e98d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042175 Sep 07 13:23:49.586982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 645/1301] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:50.940872 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:50.941518 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:50.949824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.950055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.950497 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.951238 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.951742 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.952142 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.013451 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:51.031903 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.032539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.032973 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.048630 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] Creating event network-changed:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:23:51.055119 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-d815fd90-dc97-45ab-a7e5-6880db7f981b req-77794aa1-fdf4-41de-b4e0-6f8c26009cd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118694 Sep 07 13:23:51.056458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 646/1302] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:23:51.068822 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lazy-loading 'services' on Instance uuid a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:51.156783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d18b63d6-80bb-46b2-93eb-5df6542a9a04 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments/2b1443c7-c546-4fea-8f95-db781aae8f1c" status: 202 len: 0 microversion: 2.1 time: 0.222684 Sep 07 13:23:51.157595 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 657/1303] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:23:50 2022] DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments/2b1443c7-c546-4fea-8f95-db781aae8f1c => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:51.167500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:51.172076 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:51.179986 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.180592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.182066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.182066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.185091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.185091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.226425 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-f447a819-e0ad-4fcc-99ca-3b72c594a0bf tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063669 Sep 07 13:23:51.227942 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 647/1304] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:23:51 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:52.241300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:52.244017 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.251869 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.252393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.252848 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.253747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.254479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.254904 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.285649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-aa488c0d-3fc7-4070-88ba-1efaf4e35854 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Sep 07 13:23:52.286328 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 658/1305] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:23:52 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:53.299633 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:53.301861 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:53.308728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.309232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.309688 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.310419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.311136 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.311565 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.342928 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-32011027-a03f-4cee-b351-7d34b4fab6d1 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047667 Sep 07 13:23:53.343518 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 648/1306] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 13:23:53 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:23:53.356783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:53.357569 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:53.365435 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.365986 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.366373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.367059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.367508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.367923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.457978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] HTTP exception thrown: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e is not attached to volume 2b1443c7-c546-4fea-8f95-db781aae8f1c Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Request method failure captured: Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments/2b1443c7-c546-4fea-8f95-db781aae8f1c HTTP/1.1 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJp1TwZqXy-15kQKv_A3rZ8ppd1ykz1R6QTh9rCI0xyOz5vxvAcLbPsTHWjlUZ_m4PHzdpzvwj3lzBhw9cYeqQ1BUTgKtNBTb2lBYw8dqmQt1CKkSunxBg8ZGNE8E9rrXyDFYbgejR40nmxKjBZeKTw74Bo2a1vscFJ_Pw76R5WBj48 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 5f20e431b2b140ebb7c895ebd5954f67 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:23:53.460677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5f20e431b2b140ebb7c895ebd5954f67", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 5f20e431b2b140ebb7c895ebd5954f67 Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-TestMinimumBasicScenario-1125914689-project Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 3c5f2dea7bab4b83b09c0c61b21e9700 Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-TestMinimumBasicScenario-1125914689-project Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:23:53.462570 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e is not attached to volume 2b1443c7-c546-4fea-8f95-db781aae8f1c Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'server_id': 'a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e', 'id': '2b1443c7-c546-4fea-8f95-db781aae8f1c'} Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2b1443c7-c546-4fea-8f95-db781aae8f1c. Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:23:53.463553 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e is not attached to volume 2b1443c7-c546-4fea-8f95-db781aae8f1c Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e is not attached to volume 2b1443c7-c546-4fea-8f95-db781aae8f1c Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:23:53.465137 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Returning 404 to user: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e is not attached to volume 2b1443c7-c546-4fea-8f95-db781aae8f1c {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:23:53.466358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ff2b900a-3df8-4760-9789-8a99b1cc0eb8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments/2b1443c7-c546-4fea-8f95-db781aae8f1c" status: 404 len: 154 microversion: 2.1 time: 0.109605 Sep 07 13:23:53.466358 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 659/1307] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 13:23:53 2022] DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e/os-volume_attachments/2b1443c7-c546-4fea-8f95-db781aae8f1c => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:54.618850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:54.619415 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:54.629976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.630463 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.630897 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.631606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.632048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.632460 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.660057 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:23:54.746117 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8b1e048e-4d7e-4d30-abd5-66e665a6ccc8 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 204 len: 0 microversion: 2.1 time: 0.130958 Sep 07 13:23:54.746965 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 649/1308] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:23:54 2022] DELETE /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:23:54.757424 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:54.758063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:54.764795 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.765233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.765979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.766503 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.767027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.767603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.914719 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:54.923625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9e439eb7-9ae4-464e-bf1b-8498bd16a99c tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1556 microversion: 2.1 time: 0.171523 Sep 07 13:23:54.924199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 660/1309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:54 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:55.951146 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:55.952113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:55.958971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.959453 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.959889 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.960621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.961066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.961606 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:56.104643 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:56.115299 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-bb0d5bb5-b351-4b5c-820c-76bd73382e3d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1556 microversion: 2.1 time: 0.170435 Sep 07 13:23:56.116114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 650/1310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:55 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:57.139775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:57.140437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:57.148151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.148151 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.148540 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.149339 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.149967 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.150629 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.366729 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:57.377095 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8d02fa0c-9e2c-4c4b-94a2-a87dccc568af tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1556 microversion: 2.1 time: 0.241440 Sep 07 13:23:57.377972 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 661/1311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:57 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:57.763000 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e", "name": "network-vif-deleted", "tag": "7da56cbc-6ba6-417a-a1a1-4680de5673f2"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:57.775068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.775549 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.775971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.788011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] Creating event network-vif-deleted:7da56cbc-6ba6-417a-a1a1-4680de5673f2 for instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e on hv-cinder-85331 Sep 07 13:23:57.793004 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-56193977-4589-46e2-bdbc-284399948217 req-7ee208e1-fe65-473f-ba23-857f0f7f3d1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Sep 07 13:23:57.793993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 651/1312] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:58.401287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:58.402308 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:58.410296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.410779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.411205 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.411902 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.412486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.413099 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.447818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.448474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.449343 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.449858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lazy-loading 'fault' on Instance uuid a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:58.493524 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5f2dea7bab4b83b09c0c61b21e9700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f20e431b2b140ebb7c895ebd5954f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.502356 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c3e81baf-794b-4916-a120-579636f6810d tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 200 len: 1349 microversion: 2.1 time: 0.105520 Sep 07 13:23:58.502965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 662/1313] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:58 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:59.526660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.527296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] [instance: a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.534377 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.534858 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.535290 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.536214 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.536650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.537067 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.550976 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] HTTP exception thrown: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Request method failure captured: Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e HTTP/1.1 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJp1TwZqXy-15kQKv_A3rZ8ppd1ykz1R6QTh9rCI0xyOz5vxvAcLbPsTHWjlUZ_m4PHzdpzvwj3lzBhw9cYeqQ1BUTgKtNBTb2lBYw8dqmQt1CKkSunxBg8ZGNE8E9rrXyDFYbgejR40nmxKjBZeKTw74Bo2a1vscFJ_Pw76R5WBj48 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 5f20e431b2b140ebb7c895ebd5954f67 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:23:59.552617 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5f20e431b2b140ebb7c895ebd5954f67", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5f20e431b2b140ebb7c895ebd5954f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 5f20e431b2b140ebb7c895ebd5954f67 Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125914689 Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestMinimumBasicScenario-1125914689-project Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 3c5f2dea7bab4b83b09c0c61b21e9700 Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestMinimumBasicScenario-1125914689-project Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. Sep 07 13:23:59.554592 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e'} Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:23:59.555584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. Sep 07 13:23:59.557341 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:23:59.559060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Returning 404 to user: Instance a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:23:59.559060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-965f682f-d7bd-4b6d-bf97-4393203dfe65 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e" status: 404 len: 111 microversion: 2.1 time: 0.031993 Sep 07 13:23:59.559060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 652/1314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/a1fb74f9-2f01-4ca8-8f3f-24e63c0ad59e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:59.564389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-2063ee23-fe52-45af-b2e5-f92e2d46b246 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] Calling method '.version_select at 0x7fdc41f89dc0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.589906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-2063ee23-fe52-45af-b2e5-f92e2d46b246 tempest-TestMinimumBasicScenario-1125914689 tempest-TestMinimumBasicScenario-1125914689-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1912407060" status: 202 len: 0 microversion: 2.1 time: 0.030288 Sep 07 13:23:59.590509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 663/1315] 10.222.0.17 () {58 vars in 1272 bytes} [Wed Sep 7 13:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1912407060 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:23.322677 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:23.323259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:23.325907 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:23.326717 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:23.333310 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.333838 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.334254 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.334945 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.335385 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.336230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.365694 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:23.455472 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-82d4529e-747d-447d-a5c6-d74c37f29d19 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 204 len: 0 microversion: 2.1 time: 0.136327 Sep 07 13:24:23.456225 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 653/1316] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:23 2022] DELETE /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:23.463450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:23.464312 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:23.469215 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:23.469851 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:23.477174 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.477779 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.478300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.478983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.479430 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.479854 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.628128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:23.637659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9beac84b-0028-4e10-afca-5740ea6296b4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1579 microversion: 2.1 time: 0.176528 Sep 07 13:24:23.638517 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 664/1317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:23 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:24.662577 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:24.663338 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:24.670171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.670667 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.671105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.671810 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:24.672265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:24.672687 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.824761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.833163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-79fe8015-aa29-4576-ba52-2744c947ea7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1579 microversion: 2.1 time: 0.175082 Sep 07 13:24:24.833793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 654/1318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:24 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:25.859267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.859897 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.866270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.866774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.867206 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.867913 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.868363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.868785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.944007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:25.952844 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-df4d9b5e-d3f4-4c27-88a6-d08647697478 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1511 microversion: 2.1 time: 0.098868 Sep 07 13:24:25.953446 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 665/1319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:25 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:26.482273 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea450bd-9c43-41fc-9962-b03258a29052", "name": "network-vif-deleted", "tag": "ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:26.493529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.494045 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.494517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.508608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] Creating event network-vif-deleted:ad3ae3dd-e5bc-4c5a-a0f9-094e51dff3bf for instance eea450bd-9c43-41fc-9962-b03258a29052 on hv-cinder-85331 Sep 07 13:24:26.514418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-b08827a7-8320-4036-8497-4676c2bdb0e5 req-f0c21a16-5b2e-417c-8773-fe027d16a88e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036486 Sep 07 13:24:26.518335 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 655/1320] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:26.983912 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:26.984659 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:26.991808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.992588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.993022 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.993961 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.994484 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.994933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.031216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:27.031702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:27.032194 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:27.032648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lazy-loading 'fault' on Instance uuid eea450bd-9c43-41fc-9962-b03258a29052 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:27.077583 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:27.086330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-b8201178-ed19-4ba0-b8f0-22cf96d9f006 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 200 len: 1230 microversion: 2.1 time: 0.114454 Sep 07 13:24:27.086922 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 666/1321] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:26 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:28.113321 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:28.114039 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:28.120939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.121419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.121896 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.122850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.123315 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.123731 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.137869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] HTTP exception thrown: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Request method failure captured: Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 HTTP/1.1 Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJq6WKJVhkTx1KgXeG0orLOimbZtpjOGZ0t_Q5qP31Tq4FyF4UeGfVh5yAD6HXzJUDJOYjXlgP_LtaJwdykF9-aOX-RTehAjh5w0Au4Lbl11My-DsNTIPz0C3JD2Pbnpu_TS9_rSO-OdM8s8aiFxE5xxCDQic57tzwRgoNZyT7Vtvbc Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 695a571420de439581eb614b16b327aa Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:24:28.139516 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_695a571420de439581eb614b16b327aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/695a571420de439581eb614b16b327aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-804709463 Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 695a571420de439581eb614b16b327aa Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 43a6a0b75e48405ca6385ea62768d4d9 Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:24:28.141224 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'eea450bd-9c43-41fc-9962-b03258a29052'} Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:28.142485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:24:28.144098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:24:28.145590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Returning 404 to user: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:28.145590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-387caf1e-ae75-44a2-a330-035617a6f745 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 404 len: 111 microversion: 2.1 time: 0.032456 Sep 07 13:24:28.145590 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 656/1322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:28 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:28.282083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258379571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1075767516", "security_groups": [{"name": "tempest-secgroup-smoke-1129617057"}], "block_device_mapping_v2": [{"uuid": "d800c457-6621-4c54-a25a-f93f5f9aa3a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "674af3ef-bd9d-4235-aa7b-956bf30ca542"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:28.413071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] validate_networks() for [('674af3ef-bd9d-4235-aa7b-956bf30ca542', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:24:28.839085 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:24:28.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:24:28.840542 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:24:28.841121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:24:28.841562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:24:28.853640 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.854143 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.854715 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.855732 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.856406 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.856885 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:28.874470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:24:28.878535 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for user 43a6a0b75e48405ca6385ea62768d4d9 and project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:24:28.940211 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:24:28.942363 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d800c457-6621-4c54-a25a-f93f5f9aa3a5',volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:24:29.084713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [cca8734d-32a3-4158-a7a6-2362b3d3b301] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:24:30.094812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [cca8734d-32a3-4158-a7a6-2362b3d3b301] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33882. Sep 07 13:24:30.099413 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-39750c69-5835-45aa-8102-d06d4ce2b04c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.821890 Sep 07 13:24:30.100087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 667/1323] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:24:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:24:30.114698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3b88bb62-a211-434e-a2f1-410ebc230db7 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:30.115561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3b88bb62-a211-434e-a2f1-410ebc230db7 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:30.173766 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3b88bb62-a211-434e-a2f1-410ebc230db7 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:30.184200 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3b88bb62-a211-434e-a2f1-410ebc230db7 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1095 microversion: 2.1 time: 0.075860 Sep 07 13:24:30.184825 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 657/1324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:30 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:31.215827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3cf03990-1d29-4ecd-91e3-671802e9ede8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:31.216440 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3cf03990-1d29-4ecd-91e3-671802e9ede8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:31.279990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3cf03990-1d29-4ecd-91e3-671802e9ede8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:31.288776 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3cf03990-1d29-4ecd-91e3-671802e9ede8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1095 microversion: 2.1 time: 0.076926 Sep 07 13:24:31.289534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 668/1325] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:31 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:32.313201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b1978505-d8a1-4101-8133-99e9e0fd9710 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:32.313806 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b1978505-d8a1-4101-8133-99e9e0fd9710 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:32.371201 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b1978505-d8a1-4101-8133-99e9e0fd9710 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:32.383258 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b1978505-d8a1-4101-8133-99e9e0fd9710 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1095 microversion: 2.1 time: 0.074358 Sep 07 13:24:32.383841 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 658/1326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:32 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:33.407526 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d79b1dd2-d06f-49d4-9527-e64f354576b3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:33.408114 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d79b1dd2-d06f-49d4-9527-e64f354576b3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:33.466790 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d79b1dd2-d06f-49d4-9527-e64f354576b3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:33.473979 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d79b1dd2-d06f-49d4-9527-e64f354576b3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1095 microversion: 2.1 time: 0.070747 Sep 07 13:24:33.474562 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 669/1327] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:33 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:34.496944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:34.497578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:34.505532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:34.506054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:34.506487 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:34.507162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:34.507610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:34.508059 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:34.571090 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:34.580081 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4c6d050e-d19d-444e-be26-32905543b939 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1145 microversion: 2.1 time: 0.086748 Sep 07 13:24:34.580795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 659/1328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:34 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:35.603673 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:35.604378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:35.611622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.612128 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.612559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.613624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:35.614202 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:35.614684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:35.692814 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:35.701863 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7bb6a7d8-d7f1-4458-ad93-f55290c46a9d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1211 microversion: 2.1 time: 0.102714 Sep 07 13:24:35.702454 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 670/1329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:35 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:36.726029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:36.727368 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:36.733992 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.734605 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.735270 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.735991 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:36.736453 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:36.737113 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:36.918448 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:36.926508 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7416834a-9e17-433c-b168-d7a0781c6362 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.204321 Sep 07 13:24:36.927093 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 660/1330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:36 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:37.122890 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24faf3cd-32a8-4133-a944-5978dd836705", "tag": "17457614-7848-40a5-897e-5e31e68bfe22"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:37.134702 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.135273 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.135767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.148378 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] Creating event network-changed:17457614-7848-40a5-897e-5e31e68bfe22 for instance 24faf3cd-32a8-4133-a944-5978dd836705 on hv-cinder-85331 Sep 07 13:24:37.153720 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-f48f2cbe-a102-4301-80b7-ed81ed8b0e33 req-8e713f2d-19e3-4952-bc7e-17a4b9ecef8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036303 Sep 07 13:24:37.154534 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 671/1331] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:37.950678 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:37.951306 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:37.958698 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.959176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.959601 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:37.960312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:37.960746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:37.961163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:38.105562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:38.117393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ad8232ee-e7cb-4193-b98d-d615bbce1759 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.170604 Sep 07 13:24:38.118406 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 661/1332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:37 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:39.142086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:39.142876 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:39.145305 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:39.151146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:39.151633 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:39.152097 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.152794 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:39.153900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:39.154334 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:39.303388 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:39.315229 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-db245462-233f-41c0-a9bf-851c1a9c06d0 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.177901 Sep 07 13:24:39.316025 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 672/1333] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:39 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:40.342826 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:40.343417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:40.350524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.351010 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.351447 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.352141 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:40.352600 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:40.353108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:40.501198 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:40.513421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-fa1c3e64-5f94-4837-9f2d-aa73b2d96702 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.174701 Sep 07 13:24:40.513832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 662/1334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:40 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:41.543963 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:41.544745 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:41.551983 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.552468 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.552903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.553598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:41.554087 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:41.554509 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:41.694989 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:41.703508 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f5723d25-e5a7-46f4-9f87-4e70f2f0f176 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.165199 Sep 07 13:24:41.704127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 673/1335] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:41 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:42.730597 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:42.731285 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:42.734723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=4 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.740547 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.741030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.741501 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.742264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:42.742720 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:42.743144 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:42.892529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:42.904079 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-55f08001-e5fb-4526-997d-dd3a73422ea6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.178446 Sep 07 13:24:42.904751 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 663/1336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:42 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:43.927718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:43.928632 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:43.930765 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=10 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:43.937286 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.937847 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.938284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.938997 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.939452 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.939875 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.087431 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.096624 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-ac9c4952-7044-41c5-a095-28a4923cd64c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.172824 Sep 07 13:24:44.097267 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 674/1337] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:43 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:45.120984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:45.121848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:45.129506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.130017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.130442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.131145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.131616 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.132029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.279483 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.287953 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-87eaf3e2-8c0d-40fd-9330-7643e514d46c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.171420 Sep 07 13:24:45.288623 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 664/1338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:45 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:46.314788 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.315396 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:46.321923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.322385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.322812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.323512 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.323958 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.324354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.473975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:46.482027 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-0c2355e2-a5f2-49ab-8ab8-b19a6a7a691d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.172800 Sep 07 13:24:46.482603 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 675/1339] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:47.505177 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:47.505812 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:47.513465 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:47.513964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:47.514405 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:47.515087 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:47.515532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:47.515946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:47.669574 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:47.677876 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-2f242c62-3646-42b6-83e8-25fb4cc5e056 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.177079 Sep 07 13:24:47.678458 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 665/1340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:47 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:48.428395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:48.429001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:48.438692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.439474 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.440104 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.441009 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.441737 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.442336 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.468631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lazy-loading 'flavor' on Instance uuid a9028070-ff86-41b7-bfd7-a6959761bb58 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:48.546071 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f75d683e-c3ae-4c60-a09e-8ebb9c317f46 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "POST /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58/action" status: 202 len: 0 microversion: 2.1 time: 0.123164 Sep 07 13:24:48.546588 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 676/1341] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:24:48 2022] POST /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:48.556366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:48.556772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:48.563823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.564495 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.565071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.566063 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.566757 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.567966 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.702084 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:48.702734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:48.709083 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.709565 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.710317 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.710936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.711249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.711665 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.712260 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.720384 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d98d2e9f-6863-45fc-8981-8ac129a41ff4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.168602 Sep 07 13:24:48.720958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 666/1342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:48 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:48.853709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.862019 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-99f7d36c-2194-497f-876d-78d94c054052 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.164847 Sep 07 13:24:48.862627 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 677/1343] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:48 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:49.745476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.745476 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.752586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.753071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.753871 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.754528 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.754975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.755387 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.886762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.887620 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.895096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.895096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.895466 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.896311 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.896649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.897106 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.905943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.913997 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d090ade4-75a7-4c9a-8ba3-58b9a71e8f35 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.173061 Sep 07 13:24:49.914578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 667/1344] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:50.043896 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.052204 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-5d440dac-14b0-47ba-a672-e0556f6d304a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.169543 Sep 07 13:24:50.052797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 678/1345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:50.443879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24faf3cd-32a8-4133-a944-5978dd836705", "name": "network-vif-plugged", "status": "completed", "tag": "17457614-7848-40a5-897e-5e31e68bfe22"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:50.454581 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.455048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.455852 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.467586 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] Creating event network-vif-plugged:17457614-7848-40a5-897e-5e31e68bfe22 for instance 24faf3cd-32a8-4133-a944-5978dd836705 on hv-cinder-85331 Sep 07 13:24:50.472760 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-d2e2bc3b-3efe-436a-b933-f9fe37e16e59 req-e9bc7fbe-6240-43b1-a2e4-a8a5d017448d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177110 Sep 07 13:24:50.473365 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 668/1346] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:50.938240 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.938868 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.945784 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.946293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.946731 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.947427 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.947878 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.948298 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.079049 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:51.079779 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:51.088264 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.088835 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.089379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.090772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.091108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.091536 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.104493 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:51.113121 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-181565f7-4f62-475c-922a-2946153e5f6f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.178989 Sep 07 13:24:51.113741 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 679/1347] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:50 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:51.232019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:51.242593 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-98210d9c-f37c-4ceb-a9b5-d126e7a8ee20 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1267 microversion: 2.1 time: 0.170427 Sep 07 13:24:51.243180 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 669/1348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:51 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:52.137491 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:52.138256 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:52.145265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.145783 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.146212 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.146895 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.147341 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.147755 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.267160 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:52.267920 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:52.277436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.278512 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.279036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.279912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.281277 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.282253 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.313828 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.322666 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-beed10da-7dd5-44e7-b5d8-3e5997a07a3a tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.188999 Sep 07 13:24:52.323599 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 680/1349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:52 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:52.429638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.438776 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-8bdafe3e-0823-4cb9-bda7-cd8581591440 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1455 microversion: 2.1 time: 0.175599 Sep 07 13:24:52.439347 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 670/1350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:52 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:52.461687 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:52.462300 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:52.468502 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.468992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.469425 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.470179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.470636 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.471058 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.490591 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:52.615113 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.623398 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fcc3fb11-c700-4e41-b6c0-52afbfa3494a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1455 microversion: 2.1 time: 0.165485 Sep 07 13:24:52.624006 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 681/1351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:52 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:53.348436 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.349473 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:53.352743 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:53.360196 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.360869 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.361550 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.362340 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.362797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.363218 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.366980 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:53.618842 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.634230 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3f1bb2aa-3dfc-4343-bdfc-ccd19b294ead tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.290746 Sep 07 13:24:53.635121 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 671/1352] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:54.549330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24faf3cd-32a8-4133-a944-5978dd836705", "tag": "17457614-7848-40a5-897e-5e31e68bfe22"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:54.554975 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:54.561706 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.562319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.562818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.576499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] Creating event network-changed:17457614-7848-40a5-897e-5e31e68bfe22 for instance 24faf3cd-32a8-4133-a944-5978dd836705 on hv-cinder-85331 Sep 07 13:24:54.582458 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-0d7d5858-ce0f-40e6-9173-e7ce634b8b1b req-70103f60-d054-49ea-a454-2c759ecbe1ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036667 Sep 07 13:24:54.583164 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 682/1353] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:54.665419 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.666734 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.674456 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.674933 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.675761 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.677342 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.677847 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.678482 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.866564 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.879870 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4791a57b-f2bf-41ad-89ac-dc59dabb2633 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.218536 Sep 07 13:24:54.880593 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 672/1354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:55.906415 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:55.907102 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:55.915793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.916335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.916762 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.917448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.917937 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.918448 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.082197 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:56.090681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3f121fa0-1573-42e9-9194-d9849851ee1f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.188928 Sep 07 13:24:56.091479 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 683/1355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:55 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:57.116428 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.117389 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:57.127822 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.128859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.129148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.130052 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.130634 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.131199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.279660 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.289622 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-a541a331-2854-428a-8ecd-eb6dd9dd2cb9 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.178780 Sep 07 13:24:57.290211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 673/1356] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:57 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:58.313401 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.314127 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.321285 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.321809 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.322224 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.322934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.323376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.323805 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.470116 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.478625 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fec7cf06-7df9-4c7d-8de0-7fa9d04ea141 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.169384 Sep 07 13:24:58.479193 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 684/1357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:59.505044 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:59.505767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:59.511971 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.512696 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.513028 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.513848 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.513981 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.514474 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.655639 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.665058 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-7044bc00-e18c-4d58-95ec-375daa1891ca tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.165540 Sep 07 13:24:59.665884 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 674/1358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:59 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:00.696146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:00.696789 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:00.706576 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.707236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.707792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.708747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.709389 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.710007 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.871753 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:00.880155 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-45e7ed59-b2e7-4851-bf0a-052c7ea2a456 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.189101 Sep 07 13:25:00.880709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 685/1359] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:00 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:01.913862 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:01.916213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:01.923680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.924174 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.924650 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.925366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.925851 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.926281 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.075972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:02.087493 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ed4e7ea7-987d-406d-bba6-3a78e23e0f21 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1566 microversion: 2.1 time: 0.179967 Sep 07 13:25:02.088267 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 675/1360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:01 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:02.117026 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:02.118037 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.124977 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.125483 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.126133 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.126914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.127359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.127936 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.161247 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120817) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:25:02.235914 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-fc911f94-ecdb-47f5-8e34-35c4b73a71de tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "POST /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58/action" status: 202 len: 0 microversion: 2.1 time: 0.123710 Sep 07 13:25:02.236433 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 686/1361] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:02 2022] POST /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:02.244811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.245434 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.251863 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.252442 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.255223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.255223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.255223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.255223 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.420361 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:02.429740 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d53cd20-4268-4973-84d6-05858a3fb557 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1574 microversion: 2.1 time: 0.188799 Sep 07 13:25:02.430344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 676/1362] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:03.458840 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:03.459598 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:03.466161 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.466653 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.467073 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.467764 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.468213 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.468694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.610992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.618973 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-f678aa97-1b40-477a-b1f4-9a7622b4e370 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1516 microversion: 2.1 time: 0.164714 Sep 07 13:25:03.619594 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 687/1363] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:03 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:04.646584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:04.647156 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:04.654358 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.654846 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.655280 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.656051 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.656423 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.656850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.798424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.808722 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3bba8444-3bcd-4920-9586-d58236525596 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.167461 Sep 07 13:25:04.809895 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 677/1364] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:04 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:05.832992 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.833728 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.842971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.843686 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.844272 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.845234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.845699 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.846191 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.991028 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.000001 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-780ee01f-8d7d-4bbc-9e5b-ab33f82a4f60 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.171001 Sep 07 13:25:06.000514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 688/1365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:06.300116 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "name": "network-vif-unplugged", "status": "completed", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:06.311021 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.311585 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.312107 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.324900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] Creating event network-vif-unplugged:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:25:06.330100 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-5d7a6853-46cc-40a6-861e-d4aa84016898 req-9bf4ba62-058a-4380-b932-f04ab3a4bb3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033451 Sep 07 13:25:06.330795 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 678/1366] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:07.032109 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:07.032775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:07.039827 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.040319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.040758 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.041464 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.041950 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.042376 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.191278 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:07.202297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-61209c7f-d1f0-419f-a5cf-0fe169e251ea tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.174176 Sep 07 13:25:07.202877 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 689/1367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:07 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:08.227421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:08.228066 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:08.237378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.238103 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.238844 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.239814 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.240418 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.240894 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.395893 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.406524 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-3c42951b-5f71-4f73-a0f4-c1019339ed23 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.183930 Sep 07 13:25:08.407143 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 679/1368] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:08 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:09.430547 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:09.431172 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:09.438244 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.438734 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.439165 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.439845 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.440347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.440741 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.590774 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.598894 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-39b0af41-7e21-458c-a7ae-93a003095db2 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.172281 Sep 07 13:25:09.599675 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 690/1369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:09 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:10.623794 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:10.624420 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:10.631651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.632189 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.632562 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.633312 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.633713 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.634167 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.773834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.782610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-31b69c72-8920-424f-aaeb-bc03c2e50a80 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.162925 Sep 07 13:25:10.783202 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 680/1370] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:11.806818 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.807545 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.816325 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.816824 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.817262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.818011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.818505 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.818903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.981589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.991177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d2916538-f2cc-4f55-89cb-1166cfdc31b5 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.188580 Sep 07 13:25:11.991793 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 691/1371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:11 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.016409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.017041 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.024120 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.024603 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.025149 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.026355 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.027006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.027452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.185648 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.194017 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-c6397c0b-4e7a-48c1-979b-745502f1c4f8 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.181704 Sep 07 13:25:13.194597 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 681/1372] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:14.221199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:14.221760 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:14.228495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.228965 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.229393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.230177 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.230623 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.231040 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.366184 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:14.375498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-e6de87da-edc5-475d-8cd3-8ae7fcf1279e tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1572 microversion: 2.1 time: 0.159893 Sep 07 13:25:14.383692 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 692/1373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:14 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:15.399829 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:15.400540 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:15.407608 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:15.408098 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:15.408529 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:15.409227 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:15.409697 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:15.410139 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:15.552239 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:15.561183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-ca6e1b19-b969-4c2e-b72f-19a823fe9fd0 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1559 microversion: 2.1 time: 0.165239 Sep 07 13:25:15.561832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 682/1374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:15 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:16.401330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "name": "network-vif-plugged", "status": "completed", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:16.412207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:16.412684 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:16.413110 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:16.428218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] Creating event network-vif-plugged:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:25:16.434249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-687cc818-ad9c-411a-a073-abf7f0e553c7 req-a8dfe069-0a7e-474a-970c-d93a0bb4bbe8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037439 Sep 07 13:25:16.434870 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 693/1375] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:05.270395 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6893355c-dc0f-4326-a5d3-847a1eefbaf5] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 13:27:05.271747 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:05.271902 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:05.272500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:05.272714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:05.278472 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:27:05.278472 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 07 13:27:05.278807 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=23 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:05.279259 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=67 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:05.280225 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:27:05.280387 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Wed Sep 7 13:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 (ip 10.222.0.17) !!! Sep 07 13:27:05.282777 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:05.283638 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:27:05.283767 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Wed Sep 7 13:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 (ip 10.222.0.17) !!! Sep 07 13:27:05.297547 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:05.298362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:05.298962 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:05.309222 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:05.309739 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:05.310393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:05.311296 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:05.311746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:05.312334 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:05.312662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] Creating event network-changed:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:27:05.318548 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-483fc027-0567-46f9-bbef-b34611d140dd req-73a4c882-007d-468c-875e-639488eca91d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049794 Sep 07 13:27:05.319326 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 694/1376] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:27:05.341125 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Going to try to terminate instance {{(pid=120818) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:27:05.460169 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-15fbf4d9-944b-4720-ae0e-d57b624d9826 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 204 len: 0 microversion: 2.1 time: 0.194849 Sep 07 13:27:05.460768 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 683/1377] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:27:05 2022] DELETE /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:27:05.471971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:05.472554 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:05.481615 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:05.482301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:05.482837 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:05.483662 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:05.484234 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:05.484941 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:05.710884 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:05.720158 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8540b253-fb18-4c30-b4d5-0fa3855aff32 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.252690 Sep 07 13:27:05.721057 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 695/1378] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:05 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:06.746212 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:06.747452 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:06.754914 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:06.755506 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:06.756183 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:06.756938 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:06.757533 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:06.757989 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:06.876369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1726561548", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1075767516", "security_groups": [{"name": "tempest-secgroup-smoke-1129617057"}], "block_device_mapping_v2": [{"uuid": "d79ee8f1-13be-4caf-82a8-b29a21c65845", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "674af3ef-bd9d-4235-aa7b-956bf30ca542"}]}} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:06.920593 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] [6893355c-dc0f-4326-a5d3-847a1eefbaf5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34152. Sep 07 13:27:07.007610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:07.015850 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-08e56fb6-ac76-4cba-b6b3-380650af8b5f tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1565 microversion: 2.1 time: 0.274791 Sep 07 13:27:07.016824 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 684/1379] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:06 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1565 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:07.038405 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.network.neutron [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] validate_networks() for [('674af3ef-bd9d-4235-aa7b-956bf30ca542', None, None, None, None, None)] {{(pid=120817) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:27:07.571663 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:27:07.572086 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image limits 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:27:07.572677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Flavor pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:27:07.572978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Image pref 0:0:0 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:27:07.573383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.virt.hardware [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120817) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:27:07.583990 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:07.584763 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:07.585265 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:07.586199 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:07.586711 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:07.587470 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:07.607804 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:07.612050 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.quota [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Getting quotas for user 43a6a0b75e48405ca6385ea62768d4d9 and project 695a571420de439581eb614b16b327aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120817) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:07.675971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Going to run 1 instances... {{(pid=120817) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:27:07.678269 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d79ee8f1-13be-4caf-82a8-b29a21c65845',volume_size=None,volume_type=None)] {{(pid=120817) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:27:07.831933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c1553485-fd4d-425f-a6fe-bc1436a29626 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.961146 Sep 07 13:27:07.832713 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 696/1380] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 13:27:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:27:07.853276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-114d6c13-14fd-4501-a254-0e52c225dc50 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:07.855068 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-114d6c13-14fd-4501-a254-0e52c225dc50 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:07.917217 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-114d6c13-14fd-4501-a254-0e52c225dc50 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:07.925421 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-114d6c13-14fd-4501-a254-0e52c225dc50 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1095 microversion: 2.1 time: 0.077419 Sep 07 13:27:07.926048 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 685/1381] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:07 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:08.047096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:08.048218 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:08.059093 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:08.059858 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:08.060355 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:08.061724 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:08.062384 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:08.062807 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:08.339769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:08.347923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8416bc84-a0ff-4f0d-acb3-efbf1944607d tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1447 microversion: 2.1 time: 0.311109 Sep 07 13:27:08.348495 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 697/1382] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:08 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:08.397108 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9028070-ff86-41b7-bfd7-a6959761bb58", "name": "network-vif-deleted", "tag": "e3bdd348-cb32-4489-b388-abae66b6c93a"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:08.408651 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:08.409012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:08.409450 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:08.421228 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] Creating event network-vif-deleted:e3bdd348-cb32-4489-b388-abae66b6c93a for instance a9028070-ff86-41b7-bfd7-a6959761bb58 on hv-cinder-85331 Sep 07 13:27:08.427055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-4b9bdeaf-3e0e-4449-bf3f-900d7018012f req-f1c89495-af26-4447-afb1-77eef3f5f474 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098932 Sep 07 13:27:08.430114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 686/1383] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:08.948923 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:08.949528 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:08.955746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:08.956210 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:08.956641 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:08.957330 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:08.957816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:08.958233 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.027903 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:09.036767 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-818a1b30-c0ed-457f-b413-ff8f8e7611a2 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1193 microversion: 2.1 time: 0.091979 Sep 07 13:27:09.037354 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 698/1384] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:08 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:09.374379 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:09.375054 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:09.382309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:09.383110 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:09.383245 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.383988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:09.384619 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:09.385105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.418494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:09.418982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:09.419417 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:09.419859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.objects.instance [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lazy-loading 'fault' on Instance uuid a9028070-ff86-41b7-bfd7-a6959761bb58 {{(pid=120818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:27:09.464030 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abffc071dfac402087686ed80260f31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628aff1654fc4804bbbec0333d3537b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:09.472147 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6c5b71cc-9be3-472a-a6c0-e91d1b695544 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 200 len: 1223 microversion: 2.1 time: 0.102868 Sep 07 13:27:09.472637 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 687/1385] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:09 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:10.060525 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:10.062383 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:10.068933 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.069571 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.070082 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:10.070797 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.071442 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.072257 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:10.309597 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:10.317892 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-6fc30f06-1805-4218-bc18-1a5734bdc68f tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1279 microversion: 2.1 time: 0.261726 Sep 07 13:27:10.318557 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 699/1386] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:10 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:10.497772 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:10.498503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] [instance: a9028070-ff86-41b7-bfd7-a6959761bb58] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:10.505517 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.506137 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.506578 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:10.507276 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:10.507732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:10.508153 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:10.522573 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] HTTP exception thrown: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Request method failure captured: Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 HTTP/1.1 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJrXXLD3aAGeSarxtcbRGdl1OTDq3arQh-nhVzq7CLat15JcKJqqOzqtBXtEJj_ZQxrhOsr1CqHQi_Eh-Eaf7r4B3RxidYTcz0lY6VWHaLrEkVQQ1sEek_8_s_q0Z0PfdjUByDJH9iFrnmagNhSfvdsmTXNA3-LktsvoQBn8Ye0Bx7s Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 628aff1654fc4804bbbec0333d3537b2 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestShelveInstance-1261882749 Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:27:10.524171 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/628aff1654fc4804bbbec0333d3537b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_628aff1654fc4804bbbec0333d3537b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/628aff1654fc4804bbbec0333d3537b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/628aff1654fc4804bbbec0333d3537b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestShelveInstance-1261882749 Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 628aff1654fc4804bbbec0333d3537b2 Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestShelveInstance-1261882749 Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestShelveInstance-1261882749-project Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: abffc071dfac402087686ed80260f31d Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestShelveInstance-1261882749-project Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. Sep 07 13:27:10.526176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'a9028070-ff86-41b7-bfd7-a6959761bb58'} Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:27:10.527213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. Sep 07 13:27:10.529500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:27:10.531505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Returning 404 to user: Instance a9028070-ff86-41b7-bfd7-a6959761bb58 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:27:10.531505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-908bf15b-99e7-47d1-85aa-a8df96886bc4 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58" status: 404 len: 111 microversion: 2.1 time: 0.032937 Sep 07 13:27:10.531505 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 688/1387] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:10 2022] GET /compute/v2.1/servers/a9028070-ff86-41b7-bfd7-a6959761bb58 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:27:10.699889 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-8c076216-d6a3-4d11-ad43-20a33915cf63 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] Calling method '.version_select at 0x7fdc456e04c0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:10.726372 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-8c076216-d6a3-4d11-ad43-20a33915cf63 tempest-TestShelveInstance-1261882749 tempest-TestShelveInstance-1261882749-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-706952032" status: 202 len: 0 microversion: 2.1 time: 0.031435 Sep 07 13:27:10.727262 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 700/1388] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 13:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-706952032 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:27:11.066604 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d16fe6-ba86-49cf-b717-b5e6c0933653", "tag": "329bab42-856c-47f9-a25a-d28d7c3f09c3"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:11.082680 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:11.085009 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:11.085598 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:11.098284 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] Creating event network-changed:329bab42-856c-47f9-a25a-d28d7c3f09c3 for instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 on hv-cinder-85331 Sep 07 13:27:11.103668 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-ced76a8f-b836-4158-a670-1c818bf04d2c req-0f73e300-30ba-49d2-a5d4-bb4cc4703e0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043815 Sep 07 13:27:11.104409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 689/1389] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:27:11.343373 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:11.344179 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:11.351319 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:11.351820 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:11.352255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:11.352978 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:11.353444 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:11.353900 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:11.849970 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:11.863035 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-3c0649b6-42a6-4ce6-88d3-fd55a7525bc4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.520142 Sep 07 13:27:11.884694 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 701/1390] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:11 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:12.891868 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:12.892556 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:12.900005 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:12.900860 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:12.902028 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:12.903026 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:12.903485 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:12.903903 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:13.210943 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:13.219500 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-73628fd1-35d6-4116-824a-d02037b652eb tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.332071 Sep 07 13:27:13.220164 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 690/1391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:12 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:14.244260 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:14.246735 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:14.255301 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:14.255906 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:14.256335 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:14.257236 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:14.257944 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:14.258369 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:14.449393 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:14.457816 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c14ef742-3051-4837-a097-f03c11ee2d7a tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.218804 Sep 07 13:27:14.458709 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 702/1392] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:14 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:15.481211 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:15.481975 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:15.489012 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:15.489584 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:15.490138 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:15.490840 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:15.491282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:15.491709 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:15.635101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:15.643950 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-d9cc3cab-c347-4de9-b908-772faa6f2c2d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.166651 Sep 07 13:27:15.644818 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 691/1393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:15 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:16.668417 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:16.669004 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:16.676011 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:16.676486 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:16.676918 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:16.677615 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:16.678096 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:16.678521 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:16.881288 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:16.890074 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-79dc9053-56af-447b-85d3-0bb1441b011d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.225608 Sep 07 13:27:16.890677 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 703/1394] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:16 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:17.914232 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:17.915265 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:17.923238 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell0:SELECT=2 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:17.925728 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:17.926525 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:17.926957 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:17.927800 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:17.928413 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:17.929019 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:18.073083 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:18.081172 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-79ec9c87-a2d0-45bf-aa67-ba12b118756d tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.171889 Sep 07 13:27:18.082545 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 692/1395] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:17 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:19.105332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:19.105964 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:19.108601 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=2 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:19.109052 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell0:SELECT=6 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:19.116103 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:19.116607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:19.117041 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:19.117786 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:19.118293 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:19.118721 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:19.260059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:19.268660 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-083fb6b9-91d5-4d00-ab1b-d660985b821e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.167809 Sep 07 13:27:19.269249 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 704/1396] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:19 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:20.292535 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:20.293105 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:20.300288 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.300769 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.301199 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.301932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.302378 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.302793 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.438621 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:20.446969 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b55e3e66-42dc-49d0-ba5b-f1db43148aa3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.159003 Sep 07 13:27:20.447559 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 693/1397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:20 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:21.471270 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:21.472112 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:21.480091 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:21.480666 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:21.481173 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:21.482089 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:21.482691 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:21.483145 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:21.625987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:21.634499 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d1324a3d-fefd-4b14-bea9-05a23eae5601 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.167494 Sep 07 13:27:21.634925 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 705/1398] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:21 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:22.658823 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:22.659387 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:22.666459 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.666958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.667366 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.668064 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.668532 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.668946 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.810343 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:22.818752 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-4f9f2e2a-7a3f-4c80-ae7f-ac8eb61ca579 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.163909 Sep 07 13:27:22.819641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 694/1399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:22 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:22.986055 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d16fe6-ba86-49cf-b717-b5e6c0933653", "name": "network-vif-plugged", "status": "completed", "tag": "329bab42-856c-47f9-a25a-d28d7c3f09c3"}]} {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:22.997359 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.998075 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.998568 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.014714 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.compute.server_external_events [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] Creating event network-vif-plugged:329bab42-856c-47f9-a25a-d28d7c3f09c3 for instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 on hv-cinder-85331 Sep 07 13:27:23.020635 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [req-f8b8e63c-9ab1-463f-a5c4-0841dee35b8b req-176c516f-e009-4c8b-90b5-793c5a5b577e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Sep 07 13:27:23.021695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 706/1400] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:23.843331 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:23.843982 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:23.850641 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.851130 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.851566 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.852263 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.852796 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.853327 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.993770 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:24.002162 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-419396c3-1558-47d8-956a-b0993bc18348 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.163466 Sep 07 13:27:24.002775 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 695/1401] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:23 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:25.026955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:25.027681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:25.035808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.036297 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.036733 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.037453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.037951 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.038353 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.187769 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:25.196404 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-686a7c47-315a-445e-8574-72b1e5b56cc3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1267 microversion: 2.1 time: 0.173979 Sep 07 13:27:25.197287 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 707/1402] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:25 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:26.221032 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:26.221906 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:26.231091 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.231749 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.232176 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.233029 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.233958 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.234123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.371993 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:26.380561 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1e773fa4-0e72-4cc6-9a35-8af47ec2b15e tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1454 microversion: 2.1 time: 0.164576 Sep 07 13:27:26.381145 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 696/1403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:26 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:26.406785 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:26.407537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:26.415498 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.415984 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.416484 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.417332 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.417831 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.418323 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.576834 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:26.585362 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1c03be8e-bee6-45ed-8ec3-5efcb07dc0c4 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1454 microversion: 2.1 time: 0.183292 Sep 07 13:27:26.586002 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 708/1404] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:26 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:28.463531 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d16fe6-ba86-49cf-b717-b5e6c0933653", "tag": "329bab42-856c-47f9-a25a-d28d7c3f09c3"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:28.473815 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.474309 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.474745 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.486494 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] Creating event network-changed:329bab42-856c-47f9-a25a-d28d7c3f09c3 for instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 on hv-cinder-85331 Sep 07 13:27:28.491900 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-2184fe11-9d24-4774-b44a-0caae323a06f req-3575f66a-a225-43f5-945f-ba91f8fd252a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032167 Sep 07 13:27:28.492520 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 697/1405] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:43.751589 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.753239 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG dbcounter [-] [120817] Writing DB stats nova_cell1:SELECT=72 {{(pid=120817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.754436 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:29:43.754648 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 (ip 10.222.0.17) !!! Sep 07 13:29:43.755133 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff64582a-a943-4667-8304-820dd8a318e2] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:29:43.755971 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:29:43.756180 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Wed Sep 7 13:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 (ip 10.222.0.17) !!! Sep 07 13:29:43.759297 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.760102 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG dbcounter [-] [120818] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.763254 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:43.763901 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:43.789271 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:43.790223 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:43.790839 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:43.791580 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:43.792034 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:43.792457 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:43.829030 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:43.924437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-bedb6679-f6a7-4adc-b0df-626fba644e68 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 204 len: 0 microversion: 2.1 time: 0.174587 Sep 07 13:29:43.925347 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 709/1406] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:43 2022] DELETE /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:43.931820 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d16fe6-ba86-49cf-b717-b5e6c0933653", "tag": "329bab42-856c-47f9-a25a-d28d7c3f09c3"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:43.934803 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:43.935516 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:43.941537 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:43.942059 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:43.942438 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:43.943152 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:43.943607 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:43.944032 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:43.944797 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:43.945364 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:43.946006 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:43.959036 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] Creating event network-changed:329bab42-856c-47f9-a25a-d28d7c3f09c3 for instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 on hv-cinder-85331 Sep 07 13:29:43.965007 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-d05c8864-974c-44aa-9bda-48e9255d21c7 req-05c6c985-64fc-4c34-9723-abed950c8e0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212034 Sep 07 13:29:43.965972 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 698/1407] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:44.087153 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:44.095514 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-7a92fb12-961d-4a10-bcb2-cad5be6fd849 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1578 microversion: 2.1 time: 0.165413 Sep 07 13:29:44.096296 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 710/1408] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:43 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:45.121101 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:45.121773 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:45.138055 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff64582a-a943-4667-8304-820dd8a318e2] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34348. Sep 07 13:29:45.142005 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:45.142719 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:45.143170 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:45.144424 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:45.145344 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:45.146142 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:45.286011 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:45.294300 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-1d44c589-b625-4907-87d7-88b894b26af3 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1578 microversion: 2.1 time: 0.178041 Sep 07 13:29:45.295163 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 699/1409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:45 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:46.317838 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:46.318453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:46.326309 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:46.326792 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:46.327319 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d16fe6-ba86-49cf-b717-b5e6c0933653", "name": "network-vif-deleted", "tag": "329bab42-856c-47f9-a25a-d28d7c3f09c3"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:46.327987 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:46.328883 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:46.329345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:46.329799 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:46.339916 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:46.340403 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:46.340832 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:46.354999 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] Creating event network-vif-deleted:329bab42-856c-47f9-a25a-d28d7c3f09c3 for instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 on hv-cinder-85331 Sep 07 13:29:46.361320 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-a20fb570-6c15-480a-9bfa-5dc1024dd012 req-d385632d-7a9f-4a31-bef7-a6399adaf4b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038350 Sep 07 13:29:46.361968 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 700/1410] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:46.407538 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:46.415631 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-1c694c7e-9623-42eb-8d13-d866d97dd1c8 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 200 len: 1392 microversion: 2.1 time: 0.101714 Sep 07 13:29:46.416209 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 711/1411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:46 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 1392 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:47.440645 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:47.441376 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: c8d16fe6-ba86-49cf-b717-b5e6c0933653] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:47.448944 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.449324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.449805 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.450504 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.450939 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.451391 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.465289 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] HTTP exception thrown: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Request method failure captured: Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 HTTP/1.1 Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJq6WKJVhkTx1KgXeG0orLOimbZtpjOGZ0t_Q5qP31Tq4FyF4UeGfVh5yAD6HXzJUDJOYjXlgP_LtaJwdykF9-aOX-RTehAjh5w0Au4Lbl11My-DsNTIPz0C3JD2Pbnpu_TS9_rSO-OdM8s8aiFxE5xxCDQic57tzwRgoNZyT7Vtvbc Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:29:47.466974 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_695a571420de439581eb614b16b327aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/695a571420de439581eb614b16b327aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 43a6a0b75e48405ca6385ea62768d4d9 Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. Sep 07 13:29:47.468691 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'c8d16fe6-ba86-49cf-b717-b5e6c0933653'} Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:47.469707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. Sep 07 13:29:47.471571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:47.473148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Returning 404 to user: Instance c8d16fe6-ba86-49cf-b717-b5e6c0933653 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:47.473148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-b6b8f7ae-7d64-4b18-9eee-0011c565b87c tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653" status: 404 len: 111 microversion: 2.1 time: 0.032039 Sep 07 13:29:47.473148 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 701/1412] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:47 2022] GET /compute/v2.1/servers/c8d16fe6-ba86-49cf-b717-b5e6c0933653 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:50.556681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:50.557248 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:50.558181 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24faf3cd-32a8-4133-a944-5978dd836705", "tag": "17457614-7848-40a5-897e-5e31e68bfe22"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:50.564489 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.565088 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.565606 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.566441 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.566955 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.567450 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.568970 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.569723 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.570123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.582746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] Creating event network-changed:17457614-7848-40a5-897e-5e31e68bfe22 for instance 24faf3cd-32a8-4133-a944-5978dd836705 on hv-cinder-85331 Sep 07 13:29:50.587647 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-08e48b7f-da47-4b10-a803-490557485fed req-1df4ee1d-71e0-40f5-8f5b-c494f116f88b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033439 Sep 07 13:29:50.588646 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 702/1413] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:50.596644 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Going to try to terminate instance {{(pid=120817) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:50.689146 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-75aaa660-7050-4e50-b975-a27af12396ba tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "DELETE /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 204 len: 0 microversion: 2.1 time: 0.136925 Sep 07 13:29:50.692985 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 712/1414] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:50 2022] DELETE /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:50.700372 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:50.701099 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:50.707571 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.708071 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.708507 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.709213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.709725 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.710115 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.849373 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.policy [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120818) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:50.858114 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-0ce772e7-2688-47e2-b908-c144eb274922 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1580 microversion: 2.1 time: 0.162613 Sep 07 13:29:50.858707 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 703/1415] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:50 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:51.882622 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:51.883394 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:51.890559 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:51.891123 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:51.891718 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:51.892385 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:51.892934 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:51.893436 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:52.135126 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:52.144207 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-56597191-8814-4f02-a46a-425dd967f372 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1580 microversion: 2.1 time: 0.266350 Sep 07 13:29:52.144808 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 713/1416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:51 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1580 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:52.427305 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24faf3cd-32a8-4133-a944-5978dd836705", "name": "network-vif-deleted", "tag": "17457614-7848-40a5-897e-5e31e68bfe22"}]} {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:52.437932 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:52.438409 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:52.438834 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:52.450746 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.compute.server_external_events [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] Creating event network-vif-deleted:17457614-7848-40a5-897e-5e31e68bfe22 for instance 24faf3cd-32a8-4133-a944-5978dd836705 on hv-cinder-85331 Sep 07 13:29:52.455813 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [req-c44951eb-1cfc-4c26-9257-16206ad7e99c req-fedb87d2-d321-4878-bac0-7eb55e6b0935 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 Sep 07 13:29:52.456610 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 704/1417] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:53.168064 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:53.168649 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:53.175519 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.176015 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.176453 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.177281 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.177806 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.178345 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.212284 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:53.212775 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:53.213214 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:53.213695 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.objects.instance [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lazy-loading 'fault' on Instance uuid 24faf3cd-32a8-4133-a944-5978dd836705 {{(pid=120817) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:29:53.257216 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.policy [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a6a0b75e48405ca6385ea62768d4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695a571420de439581eb614b16b327aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120817) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:53.266746 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-c22b75cd-659a-4bd2-aaa5-27abff9eae16 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 200 len: 1231 microversion: 2.1 time: 0.102615 Sep 07 13:29:53.267351 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 714/1418] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:53 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:54.293323 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:54.294060 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: 24faf3cd-32a8-4133-a944-5978dd836705] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:54.300635 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.301123 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.301591 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.302324 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.302786 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.303213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.317182 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] HTTP exception thrown: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Request method failure captured: Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 HTTP/1.1 Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJq6WKJVhkTx1KgXeG0orLOimbZtpjOGZ0t_Q5qP31Tq4FyF4UeGfVh5yAD6HXzJUDJOYjXlgP_LtaJwdykF9-aOX-RTehAjh5w0Au4Lbl11My-DsNTIPz0C3JD2Pbnpu_TS9_rSO-OdM8s8aiFxE5xxCDQic57tzwRgoNZyT7Vtvbc Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:29:54.318859 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_695a571420de439581eb614b16b327aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/695a571420de439581eb614b16b327aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 43a6a0b75e48405ca6385ea62768d4d9 Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. Sep 07 13:29:54.320539 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': '24faf3cd-32a8-4133-a944-5978dd836705'} Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:54.321503 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. Sep 07 13:29:54.323213 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.324879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Returning 404 to user: Instance 24faf3cd-32a8-4133-a944-5978dd836705 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:54.324879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-5c18adca-ae18-4551-96b6-380d8bc00667 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705" status: 404 len: 111 microversion: 2.1 time: 0.032303 Sep 07 13:29:54.324879 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 705/1419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:54 2022] GET /compute/v2.1/servers/24faf3cd-32a8-4133-a944-5978dd836705 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:54.773437 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:54.774255 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.compute.api [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120817) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:54.781148 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.781646 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.782115 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.782815 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.783379 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.783812 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG oslo_concurrency.lockutils [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.798743 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.wsgi [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] HTTP exception thrown: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Request method failure captured: Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: request: DELETE /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 HTTP/1.1 Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept: application/json Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Accept-Encoding: identity Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Connection: close Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Length: 0 Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Content-Type: application/json Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Host: 10.222.0.17 Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: Openstack-System-Scope: None Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Auth-Token: gAAAAABjGJq6WKJVhkTx1KgXeG0orLOimbZtpjOGZ0t_Q5qP31Tq4FyF4UeGfVh5yAD6HXzJUDJOYjXlgP_LtaJwdykF9-aOX-RTehAjh5w0Au4Lbl11My-DsNTIPz0C3JD2Pbnpu_TS9_rSO-OdM8s8aiFxE5xxCDQic57tzwRgoNZyT7Vtvbc Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Id: None Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Domain-Name: None Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Identity-Status: Confirmed Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Is-Admin-Project: True Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Id: default Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Domain-Name: Default Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Project-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Role: reader,member Sep 07 13:29:54.800911 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Roles: reader,member Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_695a571420de439581eb614b16b327aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/695a571420de439581eb614b16b327aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-Tenant-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Id: default Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Domain-Name: Default Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Id: 43a6a0b75e48405ca6385ea62768d4d9 Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: X-User-Name: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: method: > Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: exception: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.802678 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: action_args: {'id': 'eea450bd-9c43-41fc-9962-b03258a29052'} Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:54.803681 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.805361 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.807063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Returning 404 to user: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. {{(pid=120817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:54.807063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-9aa54e71-9494-452b-8d1a-5d4f287e6bc6 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "DELETE /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 404 len: 111 microversion: 2.1 time: 0.033504 Sep 07 13:29:54.807063 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 715/1420] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:54 2022] DELETE /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:54.812363 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '>' {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:54.812964 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.compute.api [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] [instance: eea450bd-9c43-41fc-9962-b03258a29052] Fetching instance by UUID {{(pid=120818) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:54.819325 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.819811 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.820282 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.820984 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Acquiring lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:54.821560 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:54.821988 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG oslo_concurrency.lockutils [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Lock "8cf97e1b-3f47-4ecb-8eb2-2ce42d6e1d89" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:54.835934 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.wsgi [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] HTTP exception thrown: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Request method failure captured: Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: request: GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 HTTP/1.1 Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept: application/json Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Accept-Encoding: identity Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Connection: close Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Length: 0 Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Content-Type: application/json Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Host: 10.222.0.17 Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: Openstack-System-Scope: None Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Auth-Token: gAAAAABjGJq6WKJVhkTx1KgXeG0orLOimbZtpjOGZ0t_Q5qP31Tq4FyF4UeGfVh5yAD6HXzJUDJOYjXlgP_LtaJwdykF9-aOX-RTehAjh5w0Au4Lbl11My-DsNTIPz0C3JD2Pbnpu_TS9_rSO-OdM8s8aiFxE5xxCDQic57tzwRgoNZyT7Vtvbc Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Id: None Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Domain-Name: None Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Identity-Status: Confirmed Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Is-Admin-Project: True Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Id: default Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Domain-Name: Default Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Project-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Role: reader,member Sep 07 13:29:54.837911 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Roles: reader,member Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_695a571420de439581eb614b16b327aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/695a571420de439581eb614b16b327aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/695a571420de439581eb614b16b327aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Id: 695a571420de439581eb614b16b327aa Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-Tenant-Name: tempest-TestVolumeBootPattern-804709463 Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Id: default Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Domain-Name: Default Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Id: 43a6a0b75e48405ca6385ea62768d4d9 Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: X-User-Name: tempest-TestVolumeBootPattern-804709463-project Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: method: > Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: exception: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.839732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: action_args: {'id': 'eea450bd-9c43-41fc-9962-b03258a29052'} Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: {{(pid=120818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:54.840732 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. Sep 07 13:29:54.842393 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: ERROR nova.api.openstack.wsgi Sep 07 13:29:54.843912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: DEBUG nova.api.openstack.wsgi [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Returning 404 to user: Instance eea450bd-9c43-41fc-9962-b03258a29052 could not be found. {{(pid=120818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:54.843912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: INFO nova.api.openstack.requestlog [None req-6d3376f6-1191-4463-8447-13d64eb70da9 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052" status: 404 len: 111 microversion: 2.1 time: 0.031390 Sep 07 13:29:54.843912 dv-cinder-853315-7-iscsi devstack@n-api.service[120818]: [pid: 120818|app: 0|req: 706/1421] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:54 2022] GET /compute/v2.1/servers/eea450bd-9c43-41fc-9962-b03258a29052 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:56.201331 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: DEBUG nova.api.openstack.wsgi [None req-d1702047-5e68-4c5b-81ef-591a61407635 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] Calling method '.version_select at 0x7fdc456ed8b0>' {{(pid=120817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:56.227630 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: INFO nova.api.openstack.requestlog [None req-d1702047-5e68-4c5b-81ef-591a61407635 tempest-TestVolumeBootPattern-804709463 tempest-TestVolumeBootPattern-804709463-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1075767516" status: 202 len: 0 microversion: 2.1 time: 0.032073 Sep 07 13:29:56.228242 dv-cinder-853315-7-iscsi devstack@n-api.service[120817]: [pid: 120817|app: 0|req: 716/1422] 10.222.0.17 () {58 vars in 1263 bytes} [Wed Sep 7 13:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1075767516 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)